Aug 09 12:36:28 devstack cinder-volume[78092]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 09 12:36:28 devstack cinder-volume[78092]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 09 12:36:28 devstack cinder-volume[78092]: we strongly recommend against using it for new projects. Aug 09 12:36:28 devstack cinder-volume[78092]: If you are already using Eventlet, we recommend migrating to a different Aug 09 12:36:28 devstack cinder-volume[78092]: framework. For more detail see Aug 09 12:36:28 devstack cinder-volume[78092]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 09 12:36:28 devstack cinder-volume[78092]: import eventlet # noqa Aug 09 12:36:31 devstack cinder-volume[78092]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=78092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 12:36:31 devstack cinder-volume[78092]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=78092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 12:36:31 devstack cinder-volume[78092]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=78092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 12:36:32 devstack cinder-volume[78092]: INFO dbcounter [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Registered counter for database cinder Aug 09 12:36:32 devstack cinder-volume[78092]: DEBUG oslo_db.sqlalchemy.engines [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 12:36:32 devstack cinder-volume[78092]: DEBUG dbcounter [-] [78092] Writer thread running {{(pid=78092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 09 12:36:32 devstack cinder-volume[78092]: INFO cinder.rpc [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 09 12:36:32 devstack cinder-volume[78092]: INFO cinder.rpc [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 09 12:36:32 devstack cinder-volume[78092]: DEBUG oslo_db.sqlalchemy.engines [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 12:36:32 devstack cinder-volume[78092]: INFO cinder.volume.manager [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Determined volume DB was empty at startup. Aug 09 12:36:32 devstack cinder-volume[78092]: DEBUG cinder.volume.manager [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=78092) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 09 12:36:32 devstack cinder-volume[78092]: INFO cinder.volume.manager [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 09 12:36:32 devstack cinder-volume[78092]: WARNING stevedore.named [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 09 12:36:32 devstack cinder-volume[78092]: WARNING castellan.key_manager [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 12:36:32 devstack cinder-volume[78092]: WARNING cinder.keymgr.conf_key_mgr [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 12:36:32 devstack cinder-volume[78092]: DEBUG cinder.volume.drivers.lvm [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=78092) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Aug 09 12:36:32 devstack cinder-volume[78092]: DEBUG oslo_concurrency.processutils [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=78092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_concurrency.processutils [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] CMD "cinder-rtstool verify" returned: 0 in 0.435s {{(pid=78092) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_db.sqlalchemy.engines [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 12:36:33 devstack cinder-volume[78092]: INFO cinder.rpc [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Aug 09 12:36:33 devstack cinder-volume[78092]: INFO cinder.rpc [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Aug 09 12:36:33 devstack cinder-volume[78092]: WARNING stevedore.named [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 09 12:36:33 devstack cinder-volume[78092]: WARNING castellan.key_manager [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 12:36:33 devstack cinder-volume[78092]: INFO cinder.volume.manager [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_db.sqlalchemy.engines [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78092) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 12:36:33 devstack cinder-volume[78092]: INFO oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Starting 1 workers Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Started child 78232 {{(pid=78092) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Full set of CONF: {{(pid=78092) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] ******************************************************************************** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Configuration options gathered from: {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] ================================================================================ {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] allow_availability_zone_fallback = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] allow_compression_on_image_upload = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] allowed_direct_url_schemes = [] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] api_rate_limit = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] auth_strategy = keystone {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] az_cache_duration = 3600 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_availability_zone = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_host = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_name = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_stats_polling_interval = 60 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backup_api_class = cinder.backup.api.API {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backup_name_template = backup-%s {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backup_use_same_host = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backup_use_temp_snapshot = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78232]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] chap_password = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] chap_username = {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cinder_internal_tenant_project_id = 1092ca0b36ba41359ff4ab782929e4e6 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cinder_internal_tenant_user_id = 7372a1fc000a4271b1843c3b0863a77d {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cloned_volume_same_az = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cluster = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] compression_format = gzip {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] compute_api_class = cinder.compute.nova.API {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] config_dir = [] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] config_source = [] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] control_exchange = openstack {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] debug = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] default_availability_zone = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] default_group_type = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] default_volume_type = lvmdriver-1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] disk_geometry = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] driver_client_cert = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] driver_client_cert_key = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] driver_data_namespace = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] driver_ssl_cert_path = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] driver_ssl_cert_verify = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] driver_use_ssl = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] enable_force_upload = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] enable_new_services = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] enable_unsupported_driver = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] enabled_backends = ['lvmdriver-1'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] enforce_multipath_for_image_xfer = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] filter_function = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance_api_insecure = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance_api_servers = ['http://192.168.122.7/image'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance_api_ssl_compression = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance_ca_certificates_file = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance_catalog_info = image:glance:publicURL {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance_certfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance_keyfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance_num_retries = 3 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance_request_timeout = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] goodness_function = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] graceful_shutdown_timeout = 5 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] group_api_class = cinder.group.api.API {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] host = devstack {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] image_compress_on_upload = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] image_conversion_address_space_limit = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] image_conversion_cpu_limit = 60 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78232]: INFO cinder.volume.manager [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Starting volume driver LVMVolumeDriver (3.0.0) Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] image_conversion_disable = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] image_upload_use_cinder_backend = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] image_upload_use_internal_tenant = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] image_volume_cache_enabled = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] image_volume_cache_max_count = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] image_volume_cache_max_size_gb = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] init_host_max_objects_retrieval = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] instance_format = [instance: %(uuid)s] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] iscsi_target_flags = {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] iscsi_write_cache = on {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] iser_helper = tgtadm {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] iser_ip_address = 192.168.122.7 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] iser_port = 3260 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] log_color = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] log_config_append = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] log_dir = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] log_file = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] log_options = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] log_rotate_interval = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] log_rotate_interval_type = days {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] log_rotation_type = none {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] max_age = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] max_logfile_count = 30 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] max_logfile_size_mb = 200 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] max_over_subscription_ratio = 20.0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] message_reap_interval = 86400 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] message_ttl = 2592000 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] migration_create_volume_timeout_secs = 300 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] monkey_patch = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] monkey_patch_modules = [] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] my_ip = 192.168.122.7 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] no_snapshot_gb_quota = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] num_iser_scan_tries = 3 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] num_shell_tries = 3 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] num_volume_device_scan_tries = 3 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] nvmeof_conn_info_version = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] nvmet_ns_id = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] nvmet_port_id = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] osapi_max_limit = 1000 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] osapi_volume_ext_list = [] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] osapi_volume_listen = 0.0.0.0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] osapi_volume_listen_port = 8776 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] osapi_volume_use_ssl = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] osapi_volume_workers = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] per_volume_size_limit = -1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] periodic_fuzzy_delay = 60 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] periodic_interval = 60 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] project_id_regex = [0-9a-f\-]+ {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] public_endpoint = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] publish_errors = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] quota_backup_gigabytes = 1000 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] quota_backups = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] quota_gigabytes = 1000 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] quota_groups = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] quota_snapshots = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] quota_volumes = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] rate_limit_burst = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] rate_limit_except_level = CRITICAL {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] rate_limit_interval = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] reinit_driver_count = 3 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] replication_device = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] report_discard_supported = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] report_interval = 120 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] reservation_clean_interval = 86400 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] reservation_expire = 86400 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] reserved_image_namespaces = [] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] reserved_percentage = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] rpc_response_timeout = 120 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] run_external_periodic_tasks = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] scst_target_driver = iscsi {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] scst_target_iqn_name = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] service_down_time = 720 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] shell_completion = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] snapshot_name_template = snapshot-%s {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] snapshot_same_host = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] split_loggers = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] state_path = /opt/stack/data/cinder {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] storage_availability_zone = nova {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] storage_protocol = iSCSI {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:33 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] syslog_log_facility = LOG_USER {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] target_helper = lioadm {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] target_ip_address = 192.168.122.7 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] target_port = 3260 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] target_protocol = iscsi {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] target_secondary_ip_addresses = [] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] trace_flags = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] transfer_api_class = cinder.transfer.api.API {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] transport_url = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] until_refresh = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] use_chap_auth = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] use_default_quota_class = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] use_journal = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] use_json = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] use_multipath_for_image_xfer = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] use_stderr = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] use_syslog = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] verify_glance_signatures = enabled {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] volume_api_class = cinder.volume.api.API {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] volume_backend_name = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] volume_clear = zero {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] volume_clear_ionice = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] volume_clear_size = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] volume_copy_bps_limit = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] volume_dd_blocksize = 1M {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] volume_name_template = volume-%s {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] volume_service_inithost_offload = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] volume_usage_audit_period = month {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack sudo[78236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Aug 09 12:36:33 devstack sudo[78236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] zoning_mode = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_concurrency.disable_process_locking = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.auth_section = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.auth_type = password {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.auth_version = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.cache = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.certfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.delay_auth_decision = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.http_connect_timeout = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.include_service_catalog = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.insecure = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.interface = public {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.keyfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_password = {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcache_username = {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.region_name = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.service_token_roles_required = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.service_type = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.token_cache_time = 300 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.backend = dogpile.cache.null {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.backend_argument = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.backend_expiration_time = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.config_prefix = cache.oslo {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.debug_cache_backend = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.enable_retry_client = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.enable_socket_keepalive = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.enabled = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.expiration_time = 600 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.hashclient_retry_attempts = 2 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.memcache_dead_retry = 300 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.memcache_pool_maxsize = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.memcache_sasl_enabled = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.password = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.proxies = [] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.redis_db = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.redis_sentinel_service_name = mymaster {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.redis_server = localhost:6379 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.retry_attempts = 2 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.retry_delay = 0.0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.socket_keepalive_count = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.socket_keepalive_idle = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.socket_keepalive_interval = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.socket_timeout = 1.0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.tls_allowed_ciphers = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.tls_cafile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.tls_certfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.tls_enabled = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.tls_keyfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cache.username = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] coordination.backend_url = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.asyncio_connection = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.asyncio_slave_connection = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.backend = sqlalchemy {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.connection = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.connection_debug = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.connection_parameters = {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.connection_recycle_time = 3600 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.connection_trace = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.db_inc_retry_interval = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.db_max_retries = 20 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.db_max_retry_interval = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.db_retry_interval = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.max_overflow = 50 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.max_pool_size = 5 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.max_retries = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.mysql_wsrep_sync_wait = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.pool_timeout = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.retry_interval = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.slave_connection = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.sqlite_synchronous = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.synchronous_reader = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] database.use_db_reconnect = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler.connection_string = messaging:// {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler.enabled = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler.es_doc_type = notification {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler.es_scroll_size = 10000 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler.es_scroll_time = 2m {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler.filter_error_trace = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler.hmac_keys = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler.sentinel_service_name = mymaster {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler.socket_timeout = 0.1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler.trace_requests = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler.trace_sqlalchemy = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler_jaeger.process_tags = {} {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler_jaeger.service_name_prefix = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] profiler_otlp.service_name_prefix = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_policy.enforce_new_defaults = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_policy.policy_default_rule = default {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_policy.policy_file = policy.yaml {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_policy.remote_timeout = 60.0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] privsep_osbrick.group = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] privsep_osbrick.helper_command = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] privsep_osbrick.user = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cinder_sys_admin.group = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cinder_sys_admin.helper_command = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] cinder_sys_admin.user = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] service_user.auth_section = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] service_user.auth_type = password {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] service_user.cafile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] service_user.certfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] service_user.collect_timing = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] service_user.insecure = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] service_user.keyfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] service_user.send_service_user_token = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] service_user.split_loggers = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] service_user.timeout = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance.auth_section = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance.auth_type = password {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance.certfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance.collect_timing = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance.insecure = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance.keyfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance.region_name = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance.split_loggers = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] glance.timeout = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.backend_availability_zone = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.chap_password = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.chap_username = {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.disk_geometry = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.driver_client_cert = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.driver_client_cert_key = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.driver_data_namespace = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.driver_use_ssl = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.enable_unsupported_driver = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.extra_capabilities = {} {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.filter_function = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.goodness_function = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.iscsi_target_flags = {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.iscsi_write_cache = on {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.iser_helper = tgtadm {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.iser_port = 3260 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.lvm_mirrors = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.lvm_share_target = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.lvm_type = auto {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.num_shell_tries = 3 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.nvmet_port_id = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.replication_device = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.report_discard_supported = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.reserved_percentage = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.scst_target_driver = iscsi {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.scst_target_iqn_name = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.storage_protocol = iSCSI {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.target_helper = tgtadm {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.target_port = 3260 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.target_protocol = iscsi {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.trace_flags = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.unique_fqdn_network = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.use_chap_auth = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.volume_backend_name = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.volume_clear = zero {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.volume_clear_ionice = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.volume_clear_size = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.volume_group = cinder-volumes {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_reports.file_event_handler = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_reports.log_dir = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.backend_availability_zone = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.backend_host = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.chap_password = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.chap_username = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.chiscsi_conf = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.disk_geometry = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.driver_client_cert = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.driver_data_namespace = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.driver_use_ssl = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.extra_capabilities = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.filter_function = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.goodness_function = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.iser_helper = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.iser_ip_address = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.iser_port = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.iser_target_prefix = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.lvm_conf_file = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.lvm_mirrors = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.lvm_share_target = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.lvm_type = auto {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.num_shell_tries = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.nvmet_port_id = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.replication_device = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.report_discard_supported = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.reserved_percentage = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.scst_target_driver = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.storage_protocol = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.target_helper = lioadm {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.target_ip_address = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.target_port = 3260 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.target_protocol = iscsi {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.trace_flags = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.use_chap_auth = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.volume_clear = zero {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.volume_clear_size = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] lvmdriver-1.volumes_dir = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.ssl = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.ssl_version = {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_notifications.driver = [] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_notifications.retry = -1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] oslo_messaging_notifications.transport_url = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] key_manager.fixed_key = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.barbican_api_version = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.barbican_endpoint = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.barbican_endpoint_type = public {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.barbican_region_name = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.cafile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.certfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.collect_timing = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.insecure = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.keyfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.number_of_retries = 60 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.retry_delay = 1 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.send_service_user_token = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.split_loggers = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.timeout = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.verify_ssl = True {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican.verify_ssl_path = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican_service_user.auth_section = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican_service_user.auth_type = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican_service_user.cafile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican_service_user.certfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican_service_user.collect_timing = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican_service_user.insecure = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican_service_user.keyfile = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican_service_user.split_loggers = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] barbican_service_user.timeout = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.approle_role_id = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.approle_secret_id = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.auth_method = approle {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.auth_path = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.kv_mountpoint = secret {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.kv_path = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.kv_version = 2 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.namespace = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.root_token_id = **** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.ssl_ca_crt_file = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.timeout = 60.0 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.token_file = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.token_role = None {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.use_ssl = False {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:36:33 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] ******************************************************************************** {{(pid=78092) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 09 12:36:34 devstack sudo[78236]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:34 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.298s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:34 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:34 devstack sudo[78383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 12:36:34 devstack sudo[78383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:34 devstack sudo[78383]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:34 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.275s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:34 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:36:34 devstack cinder-volume[78232]: INFO cinder.brick.local_dev.lvm [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Aug 09 12:36:34 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:34 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:34 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:34 devstack sudo[78467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 12:36:34 devstack sudo[78467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:34 devstack sudo[78467]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:34 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:34 devstack cinder-volume[78232]: DEBUG cinder.brick.local_dev.lvm [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=78232) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Aug 09 12:36:34 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:34 devstack sudo[78552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 12:36:34 devstack sudo[78552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:35 devstack sudo[78552]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:35 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.509s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:35 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:35 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:35 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:35 devstack sudo[78747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 12:36:35 devstack sudo[78747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:35 devstack sudo[78747]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:35 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.308s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:35 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:35 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:35 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:35 devstack sudo[78842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Aug 09 12:36:35 devstack sudo[78842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:35 devstack sudo[78842]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:35 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.264s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:35 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:35 devstack sudo[78845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 12:36:35 devstack sudo[78845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:36 devstack sudo[78845]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:36 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.331s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:36 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:36 devstack sudo[78929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 12:36:36 devstack sudo[78929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:36 devstack sudo[78929]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:36 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:36 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:36 devstack sudo[78932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:36:36 devstack sudo[78932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:36 devstack sudo[78932]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:36 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.337s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:36 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:36 devstack sudo[79016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 12:36:36 devstack sudo[79016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:36 devstack sudo[79016]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:36 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.301s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:36 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:36 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:36 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:36 devstack sudo[79025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 12:36:36 devstack sudo[79025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:37 devstack sudo[79025]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:37 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:37 devstack cinder-volume[78232]: INFO cinder.volume.drivers.lvm [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Enabling LVM thin provisioning by default because a thin pool exists. Aug 09 12:36:37 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:37 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:37 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:37 devstack sudo[79029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 12:36:37 devstack sudo[79029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:37 devstack sudo[79029]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:37 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.285s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:37 devstack cinder-volume[78232]: DEBUG cinder.volume.drivers.lvm [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Updating volume stats {{(pid=78232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 09 12:36:37 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:37 devstack sudo[79032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 12:36:37 devstack sudo[79032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:37 devstack sudo[79032]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:37 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:37 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:37 devstack sudo[79035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:36:37 devstack sudo[79035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:38 devstack sudo[79035]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:38 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:38 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:38 devstack sudo[79044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 12:36:38 devstack sudo[79044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:38 devstack sudo[79044]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:38 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:38 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:38 devstack sudo[79048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:36:38 devstack sudo[79048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:38 devstack sudo[79048]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:38 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:38 devstack cinder-volume[78232]: INFO cinder.volume.driver [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Driver hasn't implemented _init_vendor_properties() Aug 09 12:36:38 devstack cinder-volume[78232]: DEBUG cinder.volume.driver [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=78232) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 09 12:36:38 devstack cinder-volume[78232]: DEBUG oslo_db.sqlalchemy.engines [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=78232) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 12:36:38 devstack cinder-volume[78232]: DEBUG dbcounter [-] [78232] Writer thread running {{(pid=78232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 09 12:36:38 devstack cinder-volume[78232]: DEBUG cinder.db.api [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Building query based on filter {{(pid=78232) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 09 12:36:38 devstack cinder-volume[78232]: DEBUG cinder.image.image_utils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=78232) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 09 12:36:38 devstack cinder-volume[78232]: INFO cinder.keymgr.migration [None req-7edebcca-818b-4bd5-90c8-e6e962099791 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 09 12:36:38 devstack cinder-volume[78232]: DEBUG cinder.volume.drivers.lvm [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Updating volume stats {{(pid=78232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 09 12:36:38 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:38 devstack sudo[79051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 12:36:38 devstack sudo[79051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:39 devstack sudo[79051]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:39 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:39 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:39 devstack sudo[79057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:36:39 devstack sudo[79057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:39 devstack sudo[79057]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:39 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:39 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:39 devstack sudo[79060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 12:36:39 devstack sudo[79060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:39 devstack sudo[79060]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:39 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:39 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:39 devstack sudo[79063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:36:39 devstack sudo[79063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:39 devstack sudo[79063]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:39 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:39 devstack cinder-volume[78232]: DEBUG cinder.manager [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Notifying Schedulers of capabilities ... {{(pid=78232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:36:39 devstack cinder-volume[78232]: INFO cinder.volume.manager [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Driver initialization completed successfully. Aug 09 12:36:39 devstack cinder-volume[78232]: INFO cinder.manager [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Initiating service 2 cleanup Aug 09 12:36:39 devstack cinder-volume[78232]: INFO cinder.manager [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Service 2 cleanup completed. Aug 09 12:36:39 devstack cinder-volume[78232]: DEBUG cinder.service [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Creating RPC server for service cinder-volume {{(pid=78232) start /opt/stack/cinder/cinder/service.py:231}} Aug 09 12:36:39 devstack cinder-volume[78232]: DEBUG cinder.service [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=78232) start /opt/stack/cinder/cinder/service.py:237}} Aug 09 12:36:40 devstack cinder-volume[78232]: INFO cinder.volume.manager [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Aug 09 12:36:40 devstack cinder-volume[78232]: DEBUG cinder.volume.drivers.lvm [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Updating volume stats {{(pid=78232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 09 12:36:40 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:40 devstack sudo[79068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 12:36:40 devstack sudo[79068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:40 devstack sudo[79068]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:40 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.305s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:40 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:40 devstack sudo[79071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:36:40 devstack sudo[79071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:40 devstack sudo[79071]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:40 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:40 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:40 devstack sudo[79074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 12:36:40 devstack sudo[79074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:40 devstack sudo[79074]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:40 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:40 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:36:40 devstack sudo[79077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:36:40 devstack sudo[79077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:36:41 devstack sudo[79077]: pam_unix(sudo:session): session closed for user root Aug 09 12:36:41 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:36:41 devstack cinder-volume[78232]: INFO cinder.volume.manager [None req-99e3f8cf-56db-4a94-bfa3-d68b22f421aa None None] Driver post RPC initialization completed successfully. Aug 09 12:36:43 devstack cinder-volume[78092]: DEBUG dbcounter [-] [78092] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=78092) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:36:49 devstack cinder-volume[78232]: DEBUG dbcounter [-] [78232] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=78232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:36:51 devstack cinder-volume[78232]: DEBUG dbcounter [-] [78232] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=78232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:36:52 devstack cinder-volume[78232]: DEBUG oslo_service.periodic_task [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running periodic task VolumeManager._thread_info {{(pid=78232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:36:52 devstack cinder-volume[78232]: DEBUG cinder.volume.manager [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] thread count: 6 {{(pid=78232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:36:52 devstack cinder-volume[78232]: DEBUG cinder.volume.manager [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] thread info: [<_MainThread(MainThread, started 138970913415296)>, , , , , ] {{(pid=78232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:37:52 devstack cinder-volume[78232]: DEBUG oslo_service.periodic_task [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:37:52 devstack cinder-volume[78232]: DEBUG cinder.volume.drivers.lvm [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Updating volume stats {{(pid=78232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 09 12:37:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:37:52 devstack sudo[81250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 12:37:52 devstack sudo[81250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:37:52 devstack sudo[81250]: pam_unix(sudo:session): session closed for user root Aug 09 12:37:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:37:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:37:52 devstack sudo[81257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:37:52 devstack sudo[81257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:37:52 devstack sudo[81257]: pam_unix(sudo:session): session closed for user root Aug 09 12:37:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:37:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:37:52 devstack sudo[81260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 12:37:52 devstack sudo[81260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:37:52 devstack sudo[81260]: pam_unix(sudo:session): session closed for user root Aug 09 12:37:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:37:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:37:52 devstack sudo[81298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:37:52 devstack sudo[81298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:37:53 devstack sudo[81298]: pam_unix(sudo:session): session closed for user root Aug 09 12:37:53 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:37:53 devstack cinder-volume[78232]: DEBUG cinder.manager [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Notifying Schedulers of capabilities ... {{(pid=78232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:37:53 devstack cinder-volume[78232]: DEBUG oslo_service.periodic_task [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running periodic task VolumeManager._thread_info {{(pid=78232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:37:53 devstack cinder-volume[78232]: DEBUG cinder.volume.manager [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] thread count: 6 {{(pid=78232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:37:53 devstack cinder-volume[78232]: DEBUG cinder.volume.manager [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] thread info: [<_MainThread(MainThread, started 138970913415296)>, , , , , ] {{(pid=78232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:38:51 devstack cinder-volume[78232]: DEBUG dbcounter [-] [78232] Writing DB stats cinder:SELECT=1 {{(pid=78232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:38:51 devstack cinder-volume[78232]: DEBUG dbcounter [-] [78232] Writing DB stats cinder:UPDATE=1 {{(pid=78232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:38:52 devstack cinder-volume[78232]: DEBUG oslo_service.periodic_task [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:38:52 devstack cinder-volume[78232]: DEBUG cinder.volume.drivers.lvm [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Updating volume stats {{(pid=78232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 09 12:38:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:38:52 devstack sudo[84579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 12:38:52 devstack sudo[84579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:38:52 devstack sudo[84579]: pam_unix(sudo:session): session closed for user root Aug 09 12:38:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:38:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:38:52 devstack sudo[84582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:38:52 devstack sudo[84582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:38:52 devstack sudo[84582]: pam_unix(sudo:session): session closed for user root Aug 09 12:38:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:38:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:38:52 devstack sudo[84624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 12:38:52 devstack sudo[84624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:38:52 devstack sudo[84624]: pam_unix(sudo:session): session closed for user root Aug 09 12:38:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.249s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:38:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:38:52 devstack sudo[84629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:38:52 devstack sudo[84629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:38:53 devstack sudo[84629]: pam_unix(sudo:session): session closed for user root Aug 09 12:38:53 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:38:53 devstack cinder-volume[78232]: DEBUG cinder.manager [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Notifying Schedulers of capabilities ... {{(pid=78232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:38:53 devstack cinder-volume[78232]: DEBUG oslo_service.periodic_task [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running periodic task VolumeManager._thread_info {{(pid=78232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:38:53 devstack cinder-volume[78232]: DEBUG cinder.volume.manager [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] thread count: 6 {{(pid=78232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:38:53 devstack cinder-volume[78232]: DEBUG cinder.volume.manager [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] thread info: [<_MainThread(MainThread, started 138970913415296)>, , , , , ] {{(pid=78232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:39:52 devstack cinder-volume[78232]: DEBUG oslo_service.periodic_task [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:39:52 devstack cinder-volume[78232]: DEBUG cinder.volume.drivers.lvm [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Updating volume stats {{(pid=78232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 09 12:39:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:39:52 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 12:39:52 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:39:52 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Aug 09 12:39:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:39:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:39:52 devstack sudo[86606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:39:52 devstack sudo[86606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:39:52 devstack sudo[86606]: pam_unix(sudo:session): session closed for user root Aug 09 12:39:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.285s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:39:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:39:52 devstack sudo[86610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 12:39:52 devstack sudo[86610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:39:53 devstack sudo[86610]: pam_unix(sudo:session): session closed for user root Aug 09 12:39:53 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:39:53 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:39:53 devstack sudo[86634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:39:53 devstack sudo[86634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:39:53 devstack sudo[86634]: pam_unix(sudo:session): session closed for user root Aug 09 12:39:53 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:39:53 devstack cinder-volume[78232]: DEBUG cinder.manager [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Notifying Schedulers of capabilities ... {{(pid=78232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:40:51 devstack cinder-volume[78232]: DEBUG dbcounter [-] [78232] Writing DB stats cinder:SELECT=1 {{(pid=78232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:40:51 devstack cinder-volume[78232]: DEBUG dbcounter [-] [78232] Writing DB stats cinder:UPDATE=1 {{(pid=78232) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:40:52 devstack cinder-volume[78232]: DEBUG oslo_service.periodic_task [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=78232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:40:52 devstack cinder-volume[78232]: DEBUG cinder.volume.drivers.lvm [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Updating volume stats {{(pid=78232) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Aug 09 12:40:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:40:52 devstack sudo[87790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Aug 09 12:40:52 devstack sudo[87790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:40:52 devstack sudo[87790]: pam_unix(sudo:session): session closed for user root Aug 09 12:40:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:40:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:40:52 devstack sudo[87793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:40:52 devstack sudo[87793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:40:52 devstack sudo[87793]: pam_unix(sudo:session): session closed for user root Aug 09 12:40:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:40:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:40:52 devstack sudo[87796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Aug 09 12:40:52 devstack sudo[87796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:40:52 devstack sudo[87796]: pam_unix(sudo:session): session closed for user root Aug 09 12:40:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.258s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:40:52 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:40:52 devstack sudo[87802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Aug 09 12:40:52 devstack sudo[87802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:40:53 devstack sudo[87802]: pam_unix(sudo:session): session closed for user root Aug 09 12:40:53 devstack cinder-volume[78232]: DEBUG oslo_concurrency.processutils [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=78232) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:40:53 devstack cinder-volume[78232]: DEBUG cinder.manager [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Notifying Schedulers of capabilities ... {{(pid=78232) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:40:53 devstack cinder-volume[78232]: DEBUG oslo_service.periodic_task [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] Running periodic task VolumeManager._thread_info {{(pid=78232) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:40:53 devstack cinder-volume[78232]: DEBUG cinder.volume.manager [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] thread count: 6 {{(pid=78232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:40:53 devstack cinder-volume[78232]: DEBUG cinder.volume.manager [None req-045535c0-551b-4e20-a1e4-fc068fe14503 None None] thread info: [<_MainThread(MainThread, started 138970913415296)>, , , , , ] {{(pid=78232) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:41:09 devstack cinder-volume[78092]: INFO oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Caught SIGTERM, stopping children Aug 09 12:41:09 devstack cinder-volume[78092]: DEBUG oslo_concurrency.lockutils [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Acquiring lock "singleton_lock" {{(pid=78092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 12:41:09 devstack cinder-volume[78092]: DEBUG oslo_concurrency.lockutils [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Acquired lock "singleton_lock" {{(pid=78092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 12:41:09 devstack cinder-volume[78092]: DEBUG oslo_concurrency.lockutils [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Releasing lock "singleton_lock" {{(pid=78092) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 12:41:09 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Stop services. {{(pid=78092) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 09 12:41:09 devstack cinder-volume[78092]: DEBUG oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Killing children. {{(pid=78092) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 09 12:41:09 devstack cinder-volume[78092]: INFO oslo_service.backend._eventlet.service [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Waiting on 1 children to exit Aug 09 12:41:14 devstack cinder-volume[78232]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Aug 09 12:41:15 devstack cinder-volume[78232]: DEBUG oslo_concurrency.lockutils [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Acquiring lock "singleton_lock" {{(pid=78232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 12:41:15 devstack cinder-volume[78232]: DEBUG oslo_concurrency.lockutils [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Acquired lock "singleton_lock" {{(pid=78232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 12:41:15 devstack cinder-volume[78232]: DEBUG oslo_concurrency.lockutils [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Releasing lock "singleton_lock" {{(pid=78232) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 12:41:15 devstack cinder-volume[78232]: WARNING amqp [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 09 12:41:15 devstack cinder-volume[78232]: WARNING amqp [None req-ff650d1c-20af-471f-85c4-6f5b088fb906 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 09 12:41:15 devstack cinder-volume[88316]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 09 12:41:15 devstack cinder-volume[88316]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 09 12:41:15 devstack cinder-volume[88316]: we strongly recommend against using it for new projects. Aug 09 12:41:15 devstack cinder-volume[88316]: If you are already using Eventlet, we recommend migrating to a different Aug 09 12:41:15 devstack cinder-volume[88316]: framework. For more detail see Aug 09 12:41:15 devstack cinder-volume[88316]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 09 12:41:15 devstack cinder-volume[88316]: import eventlet # noqa Aug 09 12:41:17 devstack cinder-volume[88316]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=88316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 12:41:17 devstack cinder-volume[88316]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=88316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 12:41:17 devstack cinder-volume[88316]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=88316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 12:41:17 devstack cinder-volume[88316]: INFO dbcounter [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Registered counter for database cinder Aug 09 12:41:17 devstack cinder-volume[88316]: DEBUG oslo_db.sqlalchemy.engines [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG dbcounter [-] [88316] Writer thread running {{(pid=88316) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 09 12:41:18 devstack cinder-volume[88316]: INFO cinder.rpc [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 09 12:41:18 devstack cinder-volume[88316]: INFO cinder.rpc [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_db.sqlalchemy.engines [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 12:41:18 devstack cinder-volume[88316]: INFO cinder.volume.manager [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Determined volume DB was empty at startup. Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG cinder.volume.manager [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=88316) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 09 12:41:18 devstack cinder-volume[88316]: INFO cinder.volume.manager [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Service not found for updating active_backend_id, assuming default for driver init. Aug 09 12:41:18 devstack cinder-volume[88316]: WARNING stevedore.named [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 09 12:41:18 devstack cinder-volume[88316]: WARNING castellan.key_manager [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 12:41:18 devstack cinder-volume[88316]: WARNING cinder.keymgr.conf_key_mgr [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 12:41:18 devstack cinder-volume[88316]: INFO cinder.volume.manager [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_db.sqlalchemy.engines [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88316) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 12:41:18 devstack cinder-volume[88316]: INFO oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Starting 1 workers Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Started child 88536 {{(pid=88316) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Full set of CONF: {{(pid=88316) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] ******************************************************************************** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Configuration options gathered from: {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] ================================================================================ {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] allow_availability_zone_fallback = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] allow_compression_on_image_upload = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] allowed_direct_url_schemes = [] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] api_rate_limit = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] auth_strategy = keystone {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_availability_zone = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_host = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_name = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_stats_polling_interval = 60 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backup_api_class = cinder.backup.api.API {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backup_name_template = backup-%s {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backup_use_same_host = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backup_use_temp_snapshot = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] chap_password = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] chap_username = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88536]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cinder_internal_tenant_project_id = 1092ca0b36ba41359ff4ab782929e4e6 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cinder_internal_tenant_user_id = 7372a1fc000a4271b1843c3b0863a77d {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cluster = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] compression_format = gzip {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] compute_api_class = cinder.compute.nova.API {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] config_dir = [] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] config_source = [] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] control_exchange = openstack {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] debug = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] default_availability_zone = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] default_group_type = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] default_volume_type = QuobyteHD {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] disk_geometry = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] driver_client_cert = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] driver_client_cert_key = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] driver_data_namespace = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] driver_ssl_cert_path = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] driver_ssl_cert_verify = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] driver_use_ssl = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] enable_new_services = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] enable_unsupported_driver = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] enabled_backends = ['QuobyteHD'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] enforce_multipath_for_image_xfer = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] filter_function = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance_api_insecure = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance_api_servers = ['http://192.168.122.7/image'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance_api_ssl_compression = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance_ca_certificates_file = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance_catalog_info = image:glance:publicURL {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance_certfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance_keyfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance_num_retries = 3 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance_request_timeout = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] goodness_function = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] graceful_shutdown_timeout = 5 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] group_api_class = cinder.group.api.API {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] host = devstack {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] image_compress_on_upload = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] image_conversion_address_space_limit = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] image_conversion_cpu_limit = 60 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] image_conversion_disable = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] image_upload_use_cinder_backend = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] image_upload_use_internal_tenant = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] image_volume_cache_enabled = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] image_volume_cache_max_count = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] image_volume_cache_max_size_gb = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] init_host_max_objects_retrieval = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] instance_format = [instance: %(uuid)s] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] iscsi_target_flags = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] iscsi_write_cache = on {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] iser_helper = tgtadm {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] iser_ip_address = 192.168.122.7 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] iser_port = 3260 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] log_color = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] log_config_append = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] log_dir = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] log_file = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] log_options = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] log_rotate_interval = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] log_rotate_interval_type = days {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] log_rotation_type = none {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] max_age = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] max_logfile_count = 30 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] max_logfile_size_mb = 200 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] max_over_subscription_ratio = 20.0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] message_reap_interval = 86400 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] message_ttl = 2592000 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] migration_create_volume_timeout_secs = 300 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] monkey_patch = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] monkey_patch_modules = [] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] my_ip = 192.168.122.7 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] no_snapshot_gb_quota = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] num_iser_scan_tries = 3 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] num_shell_tries = 3 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] num_volume_device_scan_tries = 3 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] nvmeof_conn_info_version = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] nvmet_ns_id = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] nvmet_port_id = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] osapi_max_limit = 1000 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] osapi_volume_ext_list = [] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] osapi_volume_listen = 0.0.0.0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] osapi_volume_listen_port = 8776 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] osapi_volume_use_ssl = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] osapi_volume_workers = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] per_volume_size_limit = -1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] periodic_fuzzy_delay = 60 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] periodic_interval = 60 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] project_id_regex = [0-9a-f\-]+ {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] public_endpoint = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] publish_errors = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] quota_backup_gigabytes = 1000 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] quota_backups = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] quota_gigabytes = 1000 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] quota_groups = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] quota_snapshots = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] quota_volumes = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] rate_limit_burst = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] rate_limit_except_level = CRITICAL {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] rate_limit_interval = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] reinit_driver_count = 3 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] replication_device = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] report_discard_supported = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] report_interval = 120 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] reservation_clean_interval = 86400 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] reservation_expire = 86400 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] reserved_image_namespaces = [] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] reserved_percentage = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] rpc_response_timeout = 120 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] run_external_periodic_tasks = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] scst_target_driver = iscsi {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] scst_target_iqn_name = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] service_down_time = 720 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] shell_completion = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] snapshot_name_template = snapshot-%s {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] split_loggers = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] state_path = /opt/stack/data/cinder {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] storage_availability_zone = nova {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] storage_protocol = iSCSI {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] syslog_log_facility = LOG_USER {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] target_helper = lioadm {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] target_ip_address = 192.168.122.7 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] target_port = 3260 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] target_protocol = iscsi {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] target_secondary_ip_addresses = [] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] trace_flags = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] transfer_api_class = cinder.transfer.api.API {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] transport_url = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] until_refresh = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] use_chap_auth = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] use_default_quota_class = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] use_journal = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] use_json = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] use_multipath_for_image_xfer = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] use_stderr = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] use_syslog = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] verify_glance_signatures = enabled {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] volume_api_class = cinder.volume.api.API {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] volume_backend_name = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] volume_clear = zero {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] volume_clear_ionice = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] volume_clear_size = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] volume_copy_bps_limit = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] volume_dd_blocksize = 1M {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] volume_name_template = volume-%s {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] volume_service_inithost_offload = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] volume_usage_audit_period = month {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] zoning_mode = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_concurrency.disable_process_locking = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.auth_section = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.auth_type = password {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.auth_version = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.cache = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.certfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.delay_auth_decision = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.http_connect_timeout = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.include_service_catalog = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.insecure = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.interface = public {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.keyfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_password = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88536]: INFO cinder.volume.manager [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Starting volume driver QuobyteDriver (1.2) Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcache_username = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88536]: DEBUG cinder.volume.drivers.remotefs [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=88536) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.region_name = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.service_token_roles_required = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.service_type = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.token_cache_time = 300 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.backend = dogpile.cache.null {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.backend_argument = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.backend_expiration_time = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.config_prefix = cache.oslo {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.debug_cache_backend = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.enable_retry_client = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.enable_socket_keepalive = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.enabled = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.expiration_time = 600 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.hashclient_retry_attempts = 2 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.memcache_dead_retry = 300 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.memcache_pool_maxsize = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.memcache_sasl_enabled = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.password = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.proxies = [] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.redis_db = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.redis_sentinel_service_name = mymaster {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.redis_server = localhost:6379 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.retry_attempts = 2 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.retry_delay = 0.0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.socket_keepalive_count = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.socket_keepalive_idle = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.socket_keepalive_interval = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.socket_timeout = 1.0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.tls_allowed_ciphers = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.tls_cafile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.tls_certfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.tls_enabled = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.tls_keyfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cache.username = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] coordination.backend_url = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.asyncio_connection = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.asyncio_slave_connection = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.backend = sqlalchemy {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.connection = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.connection_debug = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.connection_parameters = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.connection_recycle_time = 3600 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.connection_trace = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.db_inc_retry_interval = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.db_max_retries = 20 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.db_max_retry_interval = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.db_retry_interval = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.max_overflow = 50 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.max_pool_size = 5 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.max_retries = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.mysql_wsrep_sync_wait = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.pool_timeout = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.retry_interval = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.slave_connection = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.sqlite_synchronous = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.synchronous_reader = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] database.use_db_reconnect = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler.connection_string = messaging:// {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler.enabled = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler.es_doc_type = notification {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler.es_scroll_size = 10000 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler.es_scroll_time = 2m {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler.filter_error_trace = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler.hmac_keys = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler.sentinel_service_name = mymaster {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler.socket_timeout = 0.1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler.trace_requests = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler.trace_sqlalchemy = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler_jaeger.process_tags = {} {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler_jaeger.service_name_prefix = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] profiler_otlp.service_name_prefix = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_policy.enforce_new_defaults = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_policy.policy_default_rule = default {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_policy.policy_file = policy.yaml {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_policy.remote_timeout = 60.0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] privsep_osbrick.group = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] privsep_osbrick.helper_command = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] privsep_osbrick.user = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cinder_sys_admin.group = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cinder_sys_admin.helper_command = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] cinder_sys_admin.user = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] service_user.auth_section = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] service_user.auth_type = password {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] service_user.cafile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] service_user.certfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] service_user.collect_timing = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] service_user.insecure = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] service_user.keyfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] service_user.send_service_user_token = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] service_user.split_loggers = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] service_user.timeout = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance.auth_section = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance.auth_type = password {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance.certfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance.collect_timing = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance.insecure = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance.keyfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance.region_name = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance.split_loggers = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] glance.timeout = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.backend_availability_zone = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.chap_password = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.chap_username = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.disk_geometry = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.driver_client_cert = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.driver_client_cert_key = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.driver_data_namespace = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.driver_use_ssl = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.enable_unsupported_driver = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.extra_capabilities = {} {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.filter_function = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.goodness_function = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.iscsi_target_flags = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.iscsi_write_cache = on {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.iser_helper = tgtadm {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.iser_port = 3260 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.nas_host = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.nas_login = admin {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.nas_mount_options = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.nas_password = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.nas_private_key = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.nas_share_path = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.nas_ssh_port = 22 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.num_shell_tries = 3 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.nvmet_port_id = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.quobyte_client_cfg = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.quobyte_volume_url = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.replication_device = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.report_discard_supported = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.reserved_percentage = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.scst_target_driver = iscsi {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.scst_target_iqn_name = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.storage_protocol = iSCSI {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.target_helper = tgtadm {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.target_port = 3260 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.target_protocol = iscsi {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.trace_flags = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.unique_fqdn_network = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.use_chap_auth = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.volume_backend_name = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.volume_clear = zero {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.volume_clear_ionice = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.volume_clear_size = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_reports.file_event_handler = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_reports.log_dir = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.backend_availability_zone = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.backend_host = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.chap_password = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.chap_username = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.chiscsi_conf = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.disk_geometry = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.driver_client_cert = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.driver_client_cert_key = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.driver_data_namespace = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.driver_use_ssl = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88536]: DEBUG cinder.volume.drivers.quobyte [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=88536) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 09 12:41:18 devstack cinder-volume[88536]: WARNING cinder.volume.drivers.quobyte [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.extra_capabilities = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.filter_function = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88536]: WARNING cinder.volume.drivers.quobyte [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.goodness_function = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88536]: DEBUG oslo_concurrency.processutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Running cmd (subprocess): mount.quobyte {{(pid=88536) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.iscsi_target_flags = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.iscsi_write_cache = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.iser_helper = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.iser_ip_address = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.iser_port = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.iser_target_prefix = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.nas_host = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.nas_login = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.nas_mount_options = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.nas_password = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.nas_private_key = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.nas_share_path = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.nas_ssh_port = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.num_shell_tries = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.nvmet_ns_id = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.nvmet_port_id = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.replication_device = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.report_discard_supported = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.reserved_percentage = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.scst_target_driver = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.storage_protocol = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.target_helper = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.target_ip_address = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.target_port = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.target_prefix = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.target_protocol = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.trace_flags = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.unique_fqdn_network = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.use_chap_auth = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.volume_clear = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.volume_clear_ionice = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.volume_clear_size = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] QuobyteHD.volumes_dir = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.ssl = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.ssl_version = {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_notifications.driver = [] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_notifications.retry = -1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] oslo_messaging_notifications.transport_url = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] key_manager.fixed_key = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack quobyte-client[88537]: Reading configuration file: /etc/quobyte/client.cfg Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.barbican_api_version = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.barbican_endpoint = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.barbican_endpoint_type = public {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.barbican_region_name = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.cafile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.certfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.collect_timing = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack quobyte-client[88537]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.insecure = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.keyfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.number_of_retries = 60 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.retry_delay = 1 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.send_service_user_token = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.split_loggers = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.timeout = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.verify_ssl = True {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican.verify_ssl_path = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican_service_user.auth_section = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican_service_user.auth_type = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican_service_user.cafile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican_service_user.certfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican_service_user.collect_timing = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican_service_user.insecure = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican_service_user.keyfile = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican_service_user.split_loggers = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] barbican_service_user.timeout = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.approle_role_id = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.approle_secret_id = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.auth_method = approle {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.auth_path = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.kv_mountpoint = secret {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.kv_path = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.kv_version = 2 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.namespace = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.root_token_id = **** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.ssl_ca_crt_file = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.timeout = 60.0 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.token_file = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.token_role = None {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.use_ssl = False {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:18 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] ******************************************************************************** {{(pid=88316) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 09 12:41:18 devstack cinder-volume[88536]: DEBUG oslo_concurrency.processutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] CMD "mount.quobyte" returned: 1 in 0.122s {{(pid=88536) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:41:18 devstack cinder-volume[88536]: DEBUG oslo_concurrency.lockutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88536) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:41:18 devstack cinder-volume[88536]: DEBUG oslo_concurrency.lockutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88536) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:41:18 devstack cinder-volume[88536]: DEBUG cinder.volume.drivers.quobyte [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=88536) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:41:18 devstack cinder-volume[88536]: INFO cinder.volume.drivers.quobyte [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 ... Aug 09 12:41:18 devstack cinder-volume[88536]: DEBUG oslo_concurrency.processutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 -c /etc/quobyte/client-cinder.cfg {{(pid=88536) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:41:18 devstack sudo[88543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 -c /etc/quobyte/client-cinder.cfg Aug 09 12:41:18 devstack sudo[88543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:41:19 devstack sudo[88543]: pam_unix(sudo:session): session closed for user root Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG oslo_concurrency.processutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.505s {{(pid=88536) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:41:19 devstack cinder-volume[88536]: INFO cinder.volume.drivers.quobyte [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 succeeded Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG cinder.volume.drivers.quobyte [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=88536) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG oslo_concurrency.lockutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.519s {{(pid=88536) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG oslo_concurrency.processutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=88536) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:41:19 devstack sudo[88625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:41:19 devstack sudo[88625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:41:19 devstack sudo[88625]: pam_unix(sudo:session): session closed for user root Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG oslo_concurrency.processutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.244s {{(pid=88536) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:41:19 devstack cinder-volume[88536]: INFO cinder.volume.driver [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Driver hasn't implemented _init_vendor_properties() Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG cinder.volume.driver [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576332092285, 'free_capacity_gb': 1775.7576332092285, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=88536) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG oslo_db.sqlalchemy.engines [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88536) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG dbcounter [-] [88536] Writer thread running {{(pid=88536) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG cinder.db.api [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Building query based on filter {{(pid=88536) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG cinder.image.image_utils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=88536) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 09 12:41:19 devstack cinder-volume[88536]: INFO cinder.keymgr.migration [None req-eeef1db9-cb02-4f1a-b119-0ea05e4ad6de None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG oslo_concurrency.lockutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88536) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG oslo_concurrency.lockutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88536) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG cinder.volume.drivers.quobyte [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=88536) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG cinder.volume.drivers.quobyte [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=88536) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG oslo_concurrency.lockutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=88536) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:41:19 devstack cinder-volume[88536]: DEBUG oslo_concurrency.processutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=88536) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:41:19 devstack sudo[88636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:41:19 devstack sudo[88636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:41:20 devstack sudo[88636]: pam_unix(sudo:session): session closed for user root Aug 09 12:41:20 devstack cinder-volume[88536]: DEBUG oslo_concurrency.processutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.241s {{(pid=88536) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:41:20 devstack cinder-volume[88536]: DEBUG cinder.manager [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Notifying Schedulers of capabilities ... {{(pid=88536) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:41:20 devstack cinder-volume[88536]: INFO cinder.volume.manager [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Driver initialization completed successfully. Aug 09 12:41:20 devstack cinder-volume[88536]: INFO cinder.manager [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Initiating service 3 cleanup Aug 09 12:41:20 devstack cinder-volume[88536]: INFO cinder.manager [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Service 3 cleanup completed. Aug 09 12:41:20 devstack cinder-volume[88536]: DEBUG cinder.service [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Creating RPC server for service cinder-volume {{(pid=88536) start /opt/stack/cinder/cinder/service.py:231}} Aug 09 12:41:20 devstack cinder-volume[88536]: DEBUG cinder.service [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=88536) start /opt/stack/cinder/cinder/service.py:237}} Aug 09 12:41:20 devstack cinder-volume[88536]: INFO cinder.volume.manager [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 09 12:41:20 devstack cinder-volume[88536]: DEBUG oslo_concurrency.lockutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=88536) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:41:20 devstack cinder-volume[88536]: DEBUG oslo_concurrency.lockutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=88536) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:41:20 devstack cinder-volume[88536]: DEBUG cinder.volume.drivers.quobyte [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=88536) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:41:20 devstack cinder-volume[88536]: DEBUG cinder.volume.drivers.quobyte [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=88536) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:41:20 devstack cinder-volume[88536]: DEBUG oslo_concurrency.lockutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=88536) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:41:20 devstack cinder-volume[88536]: DEBUG oslo_concurrency.processutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=88536) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:41:20 devstack sudo[88647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:41:20 devstack sudo[88647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:41:20 devstack sudo[88647]: pam_unix(sudo:session): session closed for user root Aug 09 12:41:20 devstack cinder-volume[88536]: DEBUG oslo_concurrency.processutils [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.286s {{(pid=88536) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:41:20 devstack cinder-volume[88536]: INFO cinder.volume.manager [None req-6523e566-6eea-4565-8d8b-5f0056ca0cb4 None None] Driver post RPC initialization completed successfully. Aug 09 12:41:24 devstack cinder-volume[88316]: INFO oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Caught SIGTERM, stopping children Aug 09 12:41:24 devstack cinder-volume[88316]: DEBUG oslo_concurrency.lockutils [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Acquiring lock "singleton_lock" {{(pid=88316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 12:41:24 devstack cinder-volume[88316]: DEBUG oslo_concurrency.lockutils [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Acquired lock "singleton_lock" {{(pid=88316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 12:41:24 devstack cinder-volume[88316]: DEBUG oslo_concurrency.lockutils [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Releasing lock "singleton_lock" {{(pid=88316) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 12:41:24 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Stop services. {{(pid=88316) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Aug 09 12:41:24 devstack cinder-volume[88316]: DEBUG oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Killing children. {{(pid=88316) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Aug 09 12:41:24 devstack cinder-volume[88316]: INFO oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Waiting on 1 children to exit Aug 09 12:41:28 devstack cinder-volume[88536]: DEBUG oslo_concurrency.lockutils [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Acquiring lock "singleton_lock" {{(pid=88536) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 12:41:28 devstack cinder-volume[88536]: DEBUG oslo_concurrency.lockutils [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Acquired lock "singleton_lock" {{(pid=88536) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 12:41:28 devstack cinder-volume[88536]: DEBUG oslo_concurrency.lockutils [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Releasing lock "singleton_lock" {{(pid=88536) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 12:41:28 devstack cinder-volume[88536]: WARNING amqp [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 09 12:41:28 devstack cinder-volume[88536]: WARNING amqp [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Received method (60, 30) during closing channel 1. This method will be ignored Aug 09 12:41:28 devstack cinder-volume[88316]: INFO oslo_service.backend._eventlet.service [None req-e62b240f-0ce3-4629-8a3a-67ba8e80b101 None None] Child 88536 exited with status 0 Aug 09 12:41:29 devstack cinder-volume[89001]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Aug 09 12:41:29 devstack cinder-volume[89001]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 09 12:41:29 devstack cinder-volume[89001]: we strongly recommend against using it for new projects. Aug 09 12:41:29 devstack cinder-volume[89001]: If you are already using Eventlet, we recommend migrating to a different Aug 09 12:41:29 devstack cinder-volume[89001]: framework. For more detail see Aug 09 12:41:29 devstack cinder-volume[89001]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 09 12:41:29 devstack cinder-volume[89001]: import eventlet # noqa Aug 09 12:41:31 devstack cinder-volume[89001]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=89001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Aug 09 12:41:31 devstack cinder-volume[89001]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=89001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Aug 09 12:41:31 devstack cinder-volume[89001]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=89001) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Aug 09 12:41:32 devstack cinder-volume[89001]: INFO dbcounter [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] Registered counter for database cinder Aug 09 12:41:32 devstack cinder-volume[89001]: DEBUG oslo_db.sqlalchemy.engines [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 12:41:32 devstack cinder-volume[89001]: DEBUG dbcounter [-] [89001] Writer thread running {{(pid=89001) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 09 12:41:32 devstack cinder-volume[89001]: INFO cinder.rpc [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Aug 09 12:41:32 devstack cinder-volume[89001]: INFO cinder.rpc [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_db.sqlalchemy.engines [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 12:41:33 devstack cinder-volume[89001]: INFO cinder.volume.manager [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] Determined volume DB was empty at startup. Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG cinder.volume.manager [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=89001) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Aug 09 12:41:33 devstack cinder-volume[89001]: WARNING stevedore.named [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Aug 09 12:41:33 devstack cinder-volume[89001]: WARNING castellan.key_manager [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 12:41:33 devstack cinder-volume[89001]: WARNING cinder.keymgr.conf_key_mgr [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Aug 09 12:41:33 devstack cinder-volume[89001]: INFO cinder.volume.manager [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] Image-volume cache disabled for host devstack@QuobyteHD. Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_db.sqlalchemy.engines [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89001) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 12:41:33 devstack cinder-volume[89001]: INFO oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] Starting 1 workers Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] Started child 89309 {{(pid=89001) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] Full set of CONF: {{(pid=89001) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] ******************************************************************************** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3518}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] Configuration options gathered from: {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3519}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3520}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3521}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] ================================================================================ {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3526}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] allow_availability_zone_fallback = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] allow_compression_on_image_upload = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] allowed_direct_url_schemes = [] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] api_rate_limit = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] auth_strategy = keystone {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_availability_zone = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_host = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_name = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_stats_polling_interval = 60 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backup_api_class = cinder.backup.api.API {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backup_name_template = backup-%s {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backup_use_same_host = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backup_use_temp_snapshot = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89309]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] chap_password = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] chap_username = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cinder_internal_tenant_project_id = 1092ca0b36ba41359ff4ab782929e4e6 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cinder_internal_tenant_user_id = 7372a1fc000a4271b1843c3b0863a77d {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cluster = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] compression_format = gzip {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] compute_api_class = cinder.compute.nova.API {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] config_dir = [] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] config_source = [] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] control_exchange = openstack {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] debug = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] default_availability_zone = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] default_group_type = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] default_volume_type = QuobyteHD {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] disk_geometry = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] driver_client_cert = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] driver_client_cert_key = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] driver_data_namespace = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] driver_ssl_cert_path = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] driver_ssl_cert_verify = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] driver_use_ssl = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] enable_new_services = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] enable_unsupported_driver = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] enabled_backends = ['QuobyteHD'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] enforce_multipath_for_image_xfer = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] filter_function = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance_api_insecure = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance_api_servers = ['http://192.168.122.7/image'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance_api_ssl_compression = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance_ca_certificates_file = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance_catalog_info = image:glance:publicURL {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance_certfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance_keyfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance_num_retries = 3 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance_request_timeout = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] goodness_function = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] graceful_shutdown_timeout = 5 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] group_api_class = cinder.group.api.API {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] host = devstack {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] image_compress_on_upload = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] image_conversion_address_space_limit = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] image_conversion_cpu_limit = 60 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] image_conversion_disable = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] image_upload_use_cinder_backend = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] image_upload_use_internal_tenant = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] image_volume_cache_enabled = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] image_volume_cache_max_count = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] image_volume_cache_max_size_gb = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] init_host_max_objects_retrieval = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] instance_format = [instance: %(uuid)s] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] iscsi_target_flags = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] iscsi_write_cache = on {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] iser_helper = tgtadm {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] iser_ip_address = 192.168.122.7 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] iser_port = 3260 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] log_color = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] log_config_append = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] log_dir = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] log_file = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] log_options = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] log_rotate_interval = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] log_rotate_interval_type = days {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] log_rotation_type = none {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] max_age = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] max_logfile_count = 30 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] max_logfile_size_mb = 200 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] max_over_subscription_ratio = 20.0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] message_reap_interval = 86400 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] message_ttl = 2592000 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] migration_create_volume_timeout_secs = 300 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] monkey_patch = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] monkey_patch_modules = [] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] my_ip = 192.168.122.7 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] no_snapshot_gb_quota = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] num_iser_scan_tries = 3 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] num_shell_tries = 3 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] num_volume_device_scan_tries = 3 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] nvmeof_conn_info_version = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] nvmet_ns_id = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] nvmet_port_id = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] osapi_max_limit = 1000 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] osapi_volume_ext_list = [] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] osapi_volume_listen = 0.0.0.0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] osapi_volume_listen_port = 8776 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] osapi_volume_use_ssl = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] osapi_volume_workers = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] per_volume_size_limit = -1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] periodic_fuzzy_delay = 60 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] periodic_interval = 60 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] project_id_regex = [0-9a-f\-]+ {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] public_endpoint = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] publish_errors = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Starting volume driver QuobyteDriver (1.2) Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] quota_backup_gigabytes = 1000 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] quota_backups = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] quota_gigabytes = 1000 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=89309) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] quota_groups = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] quota_snapshots = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] quota_volumes = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] rate_limit_burst = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] rate_limit_except_level = CRITICAL {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] rate_limit_interval = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] reinit_driver_count = 3 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] replication_device = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] report_discard_supported = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] report_interval = 120 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] reservation_clean_interval = 86400 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] reservation_expire = 86400 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] reserved_image_namespaces = [] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] reserved_percentage = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] rpc_response_timeout = 120 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] run_external_periodic_tasks = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] scst_target_driver = iscsi {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] scst_target_iqn_name = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] service_down_time = 720 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] shell_completion = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] snapshot_name_template = snapshot-%s {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] split_loggers = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] state_path = /opt/stack/data/cinder {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] storage_availability_zone = nova {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] storage_protocol = iSCSI {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] syslog_log_facility = LOG_USER {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] target_helper = lioadm {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] target_ip_address = 192.168.122.7 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] target_port = 3260 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] target_protocol = iscsi {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] target_secondary_ip_addresses = [] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] trace_flags = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] transfer_api_class = cinder.transfer.api.API {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] transport_url = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] until_refresh = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] use_chap_auth = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] use_default_quota_class = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] use_journal = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] use_json = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] use_multipath_for_image_xfer = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] use_stderr = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] use_syslog = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] verify_glance_signatures = enabled {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] volume_api_class = cinder.volume.api.API {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] volume_backend_name = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] volume_clear = zero {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] volume_clear_ionice = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] volume_clear_size = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] volume_copy_bps_limit = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] volume_dd_blocksize = 1M {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] volume_name_template = volume-%s {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] volume_service_inithost_offload = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] volume_usage_audit_period = month {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] zoning_mode = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_concurrency.disable_process_locking = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.auth_section = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.auth_type = password {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.auth_version = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.cache = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.certfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.delay_auth_decision = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.http_connect_timeout = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.include_service_catalog = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.insecure = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.interface = public {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.keyfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_password = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcache_username = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.region_name = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.service_token_roles_required = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.service_type = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.token_cache_time = 300 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.7/identity {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.backend = dogpile.cache.null {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.backend_argument = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.backend_expiration_time = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.config_prefix = cache.oslo {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.debug_cache_backend = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.enable_retry_client = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.enable_socket_keepalive = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.enabled = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.expiration_time = 600 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.hashclient_retry_attempts = 2 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.memcache_dead_retry = 300 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.memcache_pool_maxsize = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.memcache_sasl_enabled = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.password = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.proxies = [] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.redis_db = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.redis_sentinel_service_name = mymaster {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.redis_server = localhost:6379 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.retry_attempts = 2 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.retry_delay = 0.0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.socket_keepalive_count = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.socket_keepalive_idle = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.socket_keepalive_interval = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.socket_timeout = 1.0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.tls_allowed_ciphers = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.tls_cafile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.tls_certfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.tls_enabled = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.tls_keyfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cache.username = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] coordination.backend_url = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.asyncio_connection = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.asyncio_slave_connection = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.backend = sqlalchemy {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.connection = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.connection_debug = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.connection_parameters = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.connection_recycle_time = 3600 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.connection_trace = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.db_inc_retry_interval = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.db_max_retries = 20 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.db_max_retry_interval = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.db_retry_interval = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.max_overflow = 50 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.max_pool_size = 5 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.max_retries = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.mysql_wsrep_sync_wait = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.pool_timeout = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.retry_interval = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.slave_connection = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.sqlite_synchronous = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.synchronous_reader = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] database.use_db_reconnect = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler.connection_string = messaging:// {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler.enabled = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler.es_doc_type = notification {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler.es_scroll_size = 10000 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler.es_scroll_time = 2m {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler.filter_error_trace = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler.hmac_keys = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler.sentinel_service_name = mymaster {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler.socket_timeout = 0.1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler.trace_requests = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler.trace_sqlalchemy = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler_jaeger.process_tags = {} {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler_jaeger.service_name_prefix = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] profiler_otlp.service_name_prefix = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_policy.enforce_new_defaults = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_policy.policy_default_rule = default {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_policy.policy_file = policy.yaml {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=89309) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}} Aug 09 12:41:33 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.quobyte [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_policy.remote_timeout = 60.0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] privsep_osbrick.group = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.quobyte [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] privsep_osbrick.helper_command = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] privsep_osbrick.user = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Running cmd (subprocess): mount.quobyte {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cinder_sys_admin.group = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cinder_sys_admin.helper_command = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] cinder_sys_admin.user = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] service_user.auth_section = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] service_user.auth_type = password {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] service_user.cafile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] service_user.certfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] service_user.collect_timing = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] service_user.insecure = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] service_user.keyfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] service_user.send_service_user_token = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] service_user.split_loggers = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] service_user.timeout = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance.auth_section = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance.auth_type = password {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance.certfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance.collect_timing = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance.insecure = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance.keyfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance.region_name = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance.split_loggers = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] glance.timeout = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.backend_availability_zone = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.chap_password = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.chap_username = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.disk_geometry = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.driver_client_cert = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.driver_client_cert_key = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.driver_data_namespace = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.driver_use_ssl = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.enable_unsupported_driver = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.extra_capabilities = {} {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.filter_function = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.goodness_function = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.iscsi_target_flags = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.iscsi_write_cache = on {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.iser_helper = tgtadm {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.iser_ip_address = 192.168.122.7 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.iser_port = 3260 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.nas_host = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.nas_login = admin {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.nas_mount_options = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.nas_password = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.nas_private_key = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.nas_share_path = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.nas_ssh_port = 22 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.num_shell_tries = 3 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.nvmet_port_id = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.quobyte_client_cfg = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.quobyte_volume_url = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.replication_device = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.report_discard_supported = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.reserved_percentage = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.scst_target_driver = iscsi {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.scst_target_iqn_name = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.storage_protocol = iSCSI {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.target_helper = tgtadm {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.target_ip_address = 192.168.122.7 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.target_port = 3260 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.target_protocol = iscsi {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.trace_flags = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.unique_fqdn_network = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.use_chap_auth = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.volume_backend_name = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.volume_clear = zero {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.volume_clear_ionice = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.volume_clear_size = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_reports.file_event_handler = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_reports.log_dir = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.backend_availability_zone = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.backend_host = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.chap_password = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.chap_username = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.chiscsi_conf = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.disk_geometry = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.driver_client_cert = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.driver_client_cert_key = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.driver_data_namespace = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.driver_use_ssl = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.extra_capabilities = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.filter_function = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.goodness_function = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.iscsi_target_flags = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.iscsi_write_cache = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.iser_helper = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.iser_ip_address = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.iser_port = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.iser_target_prefix = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.nas_host = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack quobyte-client[89318]: Reading configuration file: /etc/quobyte/client.cfg Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.nas_login = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.nas_mount_options = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.nas_password = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.nas_private_key = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.nas_share_path = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack quobyte-client[89318]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.nas_ssh_port = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.num_shell_tries = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.nvmet_ns_id = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.nvmet_port_id = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.replication_device = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.report_discard_supported = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.reserved_percentage = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.scst_target_driver = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.storage_protocol = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.target_helper = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.target_ip_address = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.target_port = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.target_prefix = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.target_protocol = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.trace_flags = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.unique_fqdn_network = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.use_chap_auth = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.volume_clear = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.volume_clear_ionice = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.volume_clear_size = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] QuobyteHD.volumes_dir = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] CMD "mount.quobyte" returned: 1 in 0.065s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.ssl = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.ssl_version = {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_notifications.driver = [] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_notifications.retry = -1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] oslo_messaging_notifications.transport_url = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] key_manager.fixed_key = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.barbican_api_version = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.barbican_endpoint = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.barbican_endpoint_type = public {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.barbican_region_name = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.cafile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.certfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.collect_timing = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.insecure = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.keyfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.number_of_retries = 60 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.retry_delay = 1 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.send_service_user_token = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.split_loggers = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.timeout = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.verify_ssl = True {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican.verify_ssl_path = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican_service_user.auth_section = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican_service_user.auth_type = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican_service_user.cafile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican_service_user.certfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican_service_user.collect_timing = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican_service_user.insecure = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican_service_user.keyfile = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican_service_user.split_loggers = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] barbican_service_user.timeout = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.approle_role_id = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.approle_secret_id = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.auth_method = approle {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.auth_path = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.kv_mountpoint = secret {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.kv_path = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.kv_version = 2 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.namespace = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.root_token_id = **** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.ssl_ca_crt_file = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.timeout = 60.0 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.token_file = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.token_role = None {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.use_ssl = False {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3545}} Aug 09 12:41:33 devstack cinder-volume[89001]: DEBUG oslo_service.backend._eventlet.service [None req-45190133-c0c3-46c6-8760-ebef091fbb68 None None] ******************************************************************************** {{(pid=89001) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3552}} Aug 09 12:41:33 devstack sudo[89319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:41:33 devstack sudo[89319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:41:33 devstack sudo[89319]: pam_unix(sudo:session): session closed for user root Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.249s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:41:33 devstack cinder-volume[89309]: INFO cinder.volume.driver [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Driver hasn't implemented _init_vendor_properties() Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG cinder.volume.driver [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576332092285, 'free_capacity_gb': 1775.7576332092285, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89309) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG oslo_db.sqlalchemy.engines [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=89309) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writer thread running {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG cinder.db.api [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Building query based on filter {{(pid=89309) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=89309) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:41:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:41:33 devstack sudo[89323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:41:33 devstack cinder-volume[89309]: INFO cinder.keymgr.migration [None req-db5c4e2d-9866-4eb2-a1a3-e232c581ede7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Aug 09 12:41:33 devstack sudo[89323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:41:34 devstack sudo[89323]: pam_unix(sudo:session): session closed for user root Aug 09 12:41:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.263s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:41:34 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:41:34 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Driver initialization completed successfully. Aug 09 12:41:34 devstack cinder-volume[89309]: INFO cinder.manager [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Initiating service 3 cleanup Aug 09 12:41:34 devstack cinder-volume[89309]: INFO cinder.manager [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Service 3 cleanup completed. Aug 09 12:41:34 devstack cinder-volume[89309]: DEBUG cinder.service [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Creating RPC server for service cinder-volume {{(pid=89309) start /opt/stack/cinder/cinder/service.py:231}} Aug 09 12:41:34 devstack cinder-volume[89309]: DEBUG cinder.service [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=89309) start /opt/stack/cinder/cinder/service.py:237}} Aug 09 12:41:34 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2) Aug 09 12:41:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:41:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:41:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:41:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:41:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:41:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:41:34 devstack sudo[89332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:41:34 devstack sudo[89332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:41:34 devstack sudo[89332]: pam_unix(sudo:session): session closed for user root Aug 09 12:41:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.332s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:41:34 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-383e28d7-5007-4d30-867e-8afca71d13d7 None None] Driver post RPC initialization completed successfully. Aug 09 12:41:43 devstack cinder-volume[89001]: DEBUG dbcounter [-] [89001] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=89001) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:41:44 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=2 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:41:44 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:41:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:41:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 6 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:41:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Flow 'volume_create_manager' (3d79cf3b-d701-4945-89ae-16a7894e950f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc3c5c3-cece-440b-8dce-80ad1866f207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adc3c5c3-cece-440b-8dce-80ad1866f207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-49538528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba56f834e034e5dbcb2a41e26a6f1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:42:32Z,use_quota=True,user_id='fdc405b5e421494dbb789546f9083f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffe98a5-4b38-4158-9502-0b3ed6db17da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ffe98a5-4b38-4158-9502-0b3ed6db17da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb83504-13c1-4d0a-8951-b4bd5fc03d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb83504-13c1-4d0a-8951-b4bd5fc03d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8', 'volume_name': 'volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffde9001-c9d2-471b-8691-cd0341058c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffde9001-c9d2-471b-8691-cd0341058c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ab6c07-27ed-494b-9bad-1b523d486a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:42:31 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Volume b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8', 'volume_size': 1} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:42:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-49538528',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ba56f834e034e5dbcb2a41e26a6f1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:42:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:42:32Z,use_quota=True,user_id='fdc405b5e421494dbb789546f9083f10',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Creating volume b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:42:31 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:42:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:42:31 devstack sudo[89743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8 1073741824 Aug 09 12:42:31 devstack sudo[89743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:42:32 devstack sudo[89743]: pam_unix(sudo:session): session closed for user root Aug 09 12:42:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8 1073741824" returned: 0 in 1.101s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:42:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:42:33 devstack sudo[90083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8 Aug 09 12:42:33 devstack sudo[90083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:42:33 devstack sudo[90083]: pam_unix(sudo:session): session closed for user root Aug 09 12:42:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8" returned: 0 in 0.635s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:42:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] <== create_volume: return (1833ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:42:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:42:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7ab6c07-27ed-494b-9bad-1b523d486a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:42:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed61a11-3ecd-4b56-99e9-1ce2fa42e086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:42:33 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Volume volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8 (b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8): created successfully Aug 09 12:42:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ed61a11-3ecd-4b56-99e9-1ce2fa42e086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:42:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Flow 'volume_create_manager' (3d79cf3b-d701-4945-89ae-16a7894e950f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:42:33 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b9900ab2-b4cc-406f-a40e-c98fe3794b48 tempest-TaggedAttachmentsTest-852647173 None] Created volume successfully. Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Flow 'volume_create_manager' (b1d4ee30-7663-4331-abca-88bc0581f646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8ce42b-6c96-4012-ada3-9de717b20159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8ce42b-6c96-4012-ada3-9de717b20159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1215470409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7184d04e-2a77-436a-b8fc-4d2c71511ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa7856b7dd084759914af6883569d35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:42:39Z,use_quota=True,user_id='e135cbaec0bf4ba6ab19907c2f34ced8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f5b4f2-6e96-46c1-8d34-9a5ed4e27562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39f5b4f2-6e96-46c1-8d34-9a5ed4e27562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b983653c-66a7-4ee7-84f3-fdf9a63e6ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b983653c-66a7-4ee7-84f3-fdf9a63e6ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7184d04e-2a77-436a-b8fc-4d2c71511ff4', 'volume_name': 'volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6ff80c-0214-4a71-815a-5aaf5ecf9029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd6ff80c-0214-4a71-815a-5aaf5ecf9029) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce8e328-b630-49df-9552-e23cfcb6fc20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:42:39 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Volume 7184d04e-2a77-436a-b8fc-4d2c71511ff4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4', 'volume_size': 1} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1215470409',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7184d04e-2a77-436a-b8fc-4d2c71511ff4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa7856b7dd084759914af6883569d35f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:42:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:42:39Z,use_quota=True,user_id='e135cbaec0bf4ba6ab19907c2f34ced8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Creating volume 7184d04e-2a77-436a-b8fc-4d2c71511ff4 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:42:39 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:42:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:42:39 devstack sudo[90177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4 1073741824 Aug 09 12:42:39 devstack sudo[90177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:42:41 devstack sudo[90177]: pam_unix(sudo:session): session closed for user root Aug 09 12:42:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4 1073741824" returned: 0 in 1.278s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:42:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:42:41 devstack sudo[90202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4 Aug 09 12:42:41 devstack sudo[90202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:42:41 devstack sudo[90202]: pam_unix(sudo:session): session closed for user root Aug 09 12:42:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4" returned: 0 in 0.676s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:42:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] <== create_volume: return (2100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:42:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.104s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:42:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ce8e328-b630-49df-9552-e23cfcb6fc20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:42:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d251ecc8-f697-4ae8-b461-961b096da9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:42:41 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Volume volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4 (7184d04e-2a77-436a-b8fc-4d2c71511ff4): created successfully Aug 09 12:42:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d251ecc8-f697-4ae8-b461-961b096da9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:42:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Flow 'volume_create_manager' (b1d4ee30-7663-4331-abca-88bc0581f646) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:42:41 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a4c58d12-62f6-4661-b555-db3f3bb6adfe tempest-DeleteServersTestJSON-54010947 None] Created volume successfully. Aug 09 12:42:48 devstack cinder-volume[89309]: WARNING py.warnings [req-66356f3f-e976-4da4-9790-ca6428589692 req-b0d057aa-73a9-49d2-a97c-d734bdb3724e tempest-DeleteServersTestJSON-54010947 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Aug 09 12:42:48 devstack cinder-volume[89309]: .first() Aug 09 12:42:48 devstack cinder-volume[89309]: Aug 09 12:42:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-66356f3f-e976-4da4-9790-ca6428589692 req-b0d057aa-73a9-49d2-a97c-d734bdb3724e tempest-DeleteServersTestJSON-54010947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:42:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-66356f3f-e976-4da4-9790-ca6428589692 req-b0d057aa-73a9-49d2-a97c-d734bdb3724e tempest-DeleteServersTestJSON-54010947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:42:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-66356f3f-e976-4da4-9790-ca6428589692 req-b0d057aa-73a9-49d2-a97c-d734bdb3724e tempest-DeleteServersTestJSON-54010947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:42:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-66356f3f-e976-4da4-9790-ca6428589692 req-b0d057aa-73a9-49d2-a97c-d734bdb3724e tempest-DeleteServersTestJSON-54010947 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee87b61a-a8db-46ba-ade0-46f69e276333', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:42:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-66356f3f-e976-4da4-9790-ca6428589692 req-b0d057aa-73a9-49d2-a97c-d734bdb3724e tempest-DeleteServersTestJSON-54010947 None] attachment_update completed successfully. Aug 09 12:42:55 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-c29447f3-bea7-4963-9fcb-2754c9f60c80 req-7b492a46-a50f-49f3-9088-a26e32f86065 tempest-DeleteServersTestJSON-54010947 None] Terminate volume connection completed successfully. Aug 09 12:42:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-c29447f3-bea7-4963-9fcb-2754c9f60c80 req-7b492a46-a50f-49f3-9088-a26e32f86065 tempest-DeleteServersTestJSON-54010947 None] Deleting attachment ee87b61a-a8db-46ba-ade0-46f69e276333. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:42:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:42:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:42:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:42:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:42:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:42:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:42:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:42:57 devstack sudo[90876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:42:57 devstack sudo[90876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:42:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Acquiring lock "cinder-7184d04e-2a77-436a-b8fc-4d2c71511ff4-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:42:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Lock "cinder-7184d04e-2a77-436a-b8fc-4d2c71511ff4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:42:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Acquiring lock "cinder-quobyte-7184d04e-2a77-436a-b8fc-4d2c71511ff4" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:42:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Lock "cinder-quobyte-7184d04e-2a77-436a-b8fc-4d2c71511ff4" acquired by "delete_volume" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:42:58 devstack cinder-volume[89309]: INFO oslo.privsep.daemon [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmps0z8lmtq/privsep.sock'] Aug 09 12:42:58 devstack sudo[90881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmps0z8lmtq/privsep.sock Aug 09 12:42:58 devstack sudo[90881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:42:58 devstack sudo[90876]: pam_unix(sudo:session): session closed for user root Aug 09 12:42:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.477s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:42:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:42:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:42:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 7 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:42:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:42:59 devstack cinder-volume[89309]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Aug 09 12:42:59 devstack cinder-volume[89309]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Aug 09 12:42:59 devstack cinder-volume[89309]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Aug 09 12:42:59 devstack cinder-volume[89309]: WARNING oslo.privsep.daemon [-] privsep log: Aug 09 12:42:59 devstack cinder-volume[89309]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Aug 09 12:42:59 devstack cinder-volume[89309]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Aug 09 12:42:59 devstack cinder-volume[89309]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Aug 09 12:42:59 devstack cinder-volume[89309]: WARNING oslo.privsep.daemon [-] privsep log: Aug 09 12:42:59 devstack cinder-volume[89309]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Aug 09 12:42:59 devstack sudo[90881]: pam_unix(sudo:session): session closed for user root Aug 09 12:42:59 devstack cinder-volume[89309]: INFO oslo.privsep.daemon [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Spawned new privsep daemon via rootwrap Aug 09 12:42:59 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Accepted privsep connection to /tmp/tmps0z8lmtq/privsep.sock {{(pid=89309) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Aug 09 12:42:59 devstack cinder-volume[89309]: INFO oslo.privsep.daemon [-] privsep daemon starting Aug 09 12:42:59 devstack cinder-volume[89309]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Aug 09 12:42:59 devstack cinder-volume[89309]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Aug 09 12:42:59 devstack cinder-volume[89309]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 90888 Aug 09 12:42:59 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dee1e6e-602f-4e41-887a-d5a7a7bd23cf]: (2,) {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:42:59 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f3a417-aebe-4e76-9125-2749e62856f1]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:42:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:42:59 devstack sudo[90890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4 Aug 09 12:42:59 devstack sudo[90890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:43:00 devstack sudo[90890]: pam_unix(sudo:session): session closed for user root Aug 09 12:43:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4" returned: 0 in 0.576s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:43:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:43:00 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4 Aug 09 12:43:00 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:43:00 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Aug 09 12:43:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7184d04e-2a77-436a-b8fc-4d2c71511ff4" returned: 0 in 0.467s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:43:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Lock "cinder-quobyte-7184d04e-2a77-436a-b8fc-4d2c71511ff4" released by "delete_volume" :: held 2.790s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:43:00 devstack cinder-volume[89309]: WARNING cinder.quota [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:43:00 devstack cinder-volume[89309]: WARNING cinder.quota [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:43:00 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Created reservations ['9f684a9d-6956-479d-930e-1c22ea4643cd', 'f1238952-a86b-4783-ae2a-5f0bf27963b9', 'e8282513-1382-4994-a688-316c834f0807', 'a64095ad-9f4b-4075-9326-55708977f2ed'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:43:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:43:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:43:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:43:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:43:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:43:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:43:00 devstack sudo[90901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:43:00 devstack sudo[90901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:43:01 devstack sudo[90901]: pam_unix(sudo:session): session closed for user root Aug 09 12:43:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.252s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:43:01 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:43:01 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Deleted volume successfully. Aug 09 12:43:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8645b7d-3846-4bb6-a0fe-66e6639f3f58 tempest-DeleteServersTestJSON-54010947 None] Lock "cinder-7184d04e-2a77-436a-b8fc-4d2c71511ff4-delete_volume" released by "delete_volume" :: held 3.391s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Flow 'volume_create_manager' (3365f0f8-61c9-44c5-88c8-6cfb5a18c5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d20ab5-0245-4061-872b-874f061465bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d20ab5-0245-4061-872b-874f061465bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-308755826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeea5cc8-6c65-49ed-87d3-4d5a8b84425a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3e2a27f1bb44ddb33f9226314ee37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:43:07Z,use_quota=True,user_id='948a08f0d2a6498c9fac003cd8969ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab48a04-b10f-4a10-af72-30aa4d162a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab48a04-b10f-4a10-af72-30aa4d162a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5997093a-256e-45b7-ae7b-1504923d7b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5997093a-256e-45b7-ae7b-1504923d7b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eeea5cc8-6c65-49ed-87d3-4d5a8b84425a', 'volume_name': 'volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae805bcf-130d-4ffc-9288-01594558f141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae805bcf-130d-4ffc-9288-01594558f141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5b9cac-ab90-4341-b89b-496fa8b65159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:43:06 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Volume eeea5cc8-6c65-49ed-87d3-4d5a8b84425a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a', 'volume_size': 1} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:43:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-308755826',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eeea5cc8-6c65-49ed-87d3-4d5a8b84425a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3e2a27f1bb44ddb33f9226314ee37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:43:07Z,use_quota=True,user_id='948a08f0d2a6498c9fac003cd8969ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Creating volume eeea5cc8-6c65-49ed-87d3-4d5a8b84425a {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:43:06 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:43:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:43:06 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a 1073741824 Aug 09 12:43:06 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:43:07 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Aug 09 12:43:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a 1073741824" returned: 0 in 0.770s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:43:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:43:07 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a Aug 09 12:43:07 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:43:08 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Aug 09 12:43:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a" returned: 0 in 0.489s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:43:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] <== create_volume: return (1331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:43:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.334s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:43:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb5b9cac-ab90-4341-b89b-496fa8b65159) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:43:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb581a8-e816-4679-a54c-a17d3a517d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:43:08 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Volume volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a (eeea5cc8-6c65-49ed-87d3-4d5a8b84425a): created successfully Aug 09 12:43:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb581a8-e816-4679-a54c-a17d3a517d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:43:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Flow 'volume_create_manager' (3365f0f8-61c9-44c5-88c8-6cfb5a18c5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:43:08 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5a3aad4e-1f3f-43a0-ae9d-326c768f6ce5 tempest-AttachVolumeTestJSON-1680535427 None] Created volume successfully. Aug 09 12:43:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-a40ae091-ea85-4182-bbae-c2a2ff545057 req-5b09817d-137c-4441-9a35-b857cf42cc06 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:43:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-a40ae091-ea85-4182-bbae-c2a2ff545057 req-5b09817d-137c-4441-9a35-b857cf42cc06 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:43:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-a40ae091-ea85-4182-bbae-c2a2ff545057 req-5b09817d-137c-4441-9a35-b857cf42cc06 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:43:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-a40ae091-ea85-4182-bbae-c2a2ff545057 req-5b09817d-137c-4441-9a35-b857cf42cc06 tempest-AttachVolumeTestJSON-1680535427 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b62e8158-ad10-4d70-8deb-be36ca6dda73', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:43:10 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-a40ae091-ea85-4182-bbae-c2a2ff545057 req-5b09817d-137c-4441-9a35-b857cf42cc06 tempest-AttachVolumeTestJSON-1680535427 None] attachment_update completed successfully. Aug 09 12:43:20 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=24,cinder:UPDATE=21,cinder:DELETE=3,cinder:INSERT=3 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:43:20 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=26,cinder:INSERT=4,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:43:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-3ae08c61-cba8-4be0-874d-7740346ff94b req-ad4b3caa-7289-4a7e-8f12-95905ab3cc62 tempest-TaggedAttachmentsTest-852647173 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:43:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-3ae08c61-cba8-4be0-874d-7740346ff94b req-ad4b3caa-7289-4a7e-8f12-95905ab3cc62 tempest-TaggedAttachmentsTest-852647173 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:43:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-3ae08c61-cba8-4be0-874d-7740346ff94b req-ad4b3caa-7289-4a7e-8f12-95905ab3cc62 tempest-TaggedAttachmentsTest-852647173 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:43:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-3ae08c61-cba8-4be0-874d-7740346ff94b req-ad4b3caa-7289-4a7e-8f12-95905ab3cc62 tempest-TaggedAttachmentsTest-852647173 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6aa5fe62-8b09-4bc3-af5d-7076979b3119', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:43:37 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-3ae08c61-cba8-4be0-874d-7740346ff94b req-ad4b3caa-7289-4a7e-8f12-95905ab3cc62 tempest-TaggedAttachmentsTest-852647173 None] attachment_update completed successfully. Aug 09 12:43:41 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-f565afdc-40fd-40a9-be6c-c98fa3c004a5 req-c1a934e4-52f2-4b90-9814-b0a7eb6d32fa tempest-TaggedAttachmentsTest-852647173 None] Terminate volume connection completed successfully. Aug 09 12:43:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-f565afdc-40fd-40a9-be6c-c98fa3c004a5 req-c1a934e4-52f2-4b90-9814-b0a7eb6d32fa tempest-TaggedAttachmentsTest-852647173 None] Deleting attachment 6aa5fe62-8b09-4bc3-af5d-7076979b3119. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:43:51 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:43:51 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=3,cinder:SELECT=7 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:43:56 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-37c49d57-7c59-4bfd-b8d7-c671532572f8 req-4b0ce7c9-05e7-4a73-8923-fc4c9b1f5bfd tempest-AttachVolumeTestJSON-1680535427 None] Terminate volume connection completed successfully. Aug 09 12:43:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-37c49d57-7c59-4bfd-b8d7-c671532572f8 req-4b0ce7c9-05e7-4a73-8923-fc4c9b1f5bfd tempest-AttachVolumeTestJSON-1680535427 None] Deleting attachment b62e8158-ad10-4d70-8deb-be36ca6dda73. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:43:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:43:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:43:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:43:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:43:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:43:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:43:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:43:57 devstack sudo[92274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:43:57 devstack sudo[92274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:43:58 devstack sudo[92274]: pam_unix(sudo:session): session closed for user root Aug 09 12:43:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.392s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:43:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:43:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:43:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 8 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:43:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:43:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Acquiring lock "cinder-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:43:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Lock "cinder-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:43:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Acquiring lock "cinder-quobyte-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:43:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Lock "cinder-quobyte-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8" acquired by "delete_volume" :: waited 0.033s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:43:58 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e564464-74de-4732-8fa8-69d6dd283fda]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:43:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:43:58 devstack sudo[92278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8 Aug 09 12:43:58 devstack sudo[92278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:43:59 devstack sudo[92278]: pam_unix(sudo:session): session closed for user root Aug 09 12:43:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8" returned: 0 in 0.797s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:43:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:43:59 devstack sudo[92293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8 Aug 09 12:43:59 devstack sudo[92293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:43:59 devstack sudo[92293]: pam_unix(sudo:session): session closed for user root Aug 09 12:43:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8" returned: 0 in 0.297s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:43:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Lock "cinder-quobyte-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8" released by "delete_volume" :: held 1.186s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:43:59 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Created reservations ['60cdfe51-d3c4-4d63-81a1-070f284c92e0', '9403969a-8504-44ad-bc3a-5cfe362e1820', '236a4feb-006f-44e9-a33f-dc48fc078b57', 'acffc897-e2ec-4042-aebe-112fae8575e6'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:43:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:43:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:43:59 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:43:59 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:43:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:43:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:43:59 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:43:59 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:44:00 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Aug 09 12:44:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.584s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:44:00 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:44:00 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Deleted volume successfully. Aug 09 12:44:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3a225daa-30bd-495e-9db3-5bec3d7f5da0 tempest-TaggedAttachmentsTest-852647173 None] Lock "cinder-b0a7bcfb-3601-4eb6-9dc0-31dbcdfcbcb8-delete_volume" released by "delete_volume" :: held 2.237s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Flow 'volume_create_manager' (64f4220f-7684-4766-add1-15c173d65b8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a5f6b5-51df-4380-a3c8-195b905abdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a5f6b5-51df-4380-a3c8-195b905abdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2065606120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8395a8e7-f924-4a99-9474-e3557e391e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d09d6b2f2ed4bf28b08b1745cc8458e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:44:07Z,use_quota=True,user_id='5899614169e6404f9add3c3493e909db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2662053-2066-4682-bb5d-14e7eb15eeef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d2662053-2066-4682-bb5d-14e7eb15eeef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f750643b-a9f2-424a-80f5-5eb322256a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f750643b-a9f2-424a-80f5-5eb322256a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8395a8e7-f924-4a99-9474-e3557e391e45', 'volume_name': 'volume-8395a8e7-f924-4a99-9474-e3557e391e45', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d6ca4f-615f-4db0-a24e-756c0e11e35a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d5d6ca4f-615f-4db0-a24e-756c0e11e35a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb208eed-d6fa-413a-9ebe-98cfefa577e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:44:06 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Volume 8395a8e7-f924-4a99-9474-e3557e391e45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8395a8e7-f924-4a99-9474-e3557e391e45', 'volume_size': 1} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:44:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-2065606120',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8395a8e7-f924-4a99-9474-e3557e391e45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d09d6b2f2ed4bf28b08b1745cc8458e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:44:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:44:07Z,use_quota=True,user_id='5899614169e6404f9add3c3493e909db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Creating volume 8395a8e7-f924-4a99-9474-e3557e391e45 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:44:06 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:44:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8395a8e7-f924-4a99-9474-e3557e391e45 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:44:06 devstack sudo[92511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8395a8e7-f924-4a99-9474-e3557e391e45 1073741824 Aug 09 12:44:06 devstack sudo[92511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:44:07 devstack sudo[92511]: pam_unix(sudo:session): session closed for user root Aug 09 12:44:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8395a8e7-f924-4a99-9474-e3557e391e45 1073741824" returned: 0 in 1.017s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:44:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8395a8e7-f924-4a99-9474-e3557e391e45 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:44:07 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8395a8e7-f924-4a99-9474-e3557e391e45 Aug 09 12:44:07 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:44:08 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Aug 09 12:44:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8395a8e7-f924-4a99-9474-e3557e391e45" returned: 0 in 0.303s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:44:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:44:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:44:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb208eed-d6fa-413a-9ebe-98cfefa577e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8395a8e7-f924-4a99-9474-e3557e391e45', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:44:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0a455d-3e64-4d27-b395-f047654ad624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:44:08 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Volume volume-8395a8e7-f924-4a99-9474-e3557e391e45 (8395a8e7-f924-4a99-9474-e3557e391e45): created successfully Aug 09 12:44:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0a455d-3e64-4d27-b395-f047654ad624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:44:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Flow 'volume_create_manager' (64f4220f-7684-4766-add1-15c173d65b8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:44:08 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-3e7156f1-04f3-45a2-a589-16ed7b62b8e7 tempest-VolumesAdminNegativeTest-1276415830 None] Created volume successfully. Aug 09 12:44:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Acquiring lock "cinder-8395a8e7-f924-4a99-9474-e3557e391e45-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:44:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Lock "cinder-8395a8e7-f924-4a99-9474-e3557e391e45-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:44:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Acquiring lock "cinder-quobyte-8395a8e7-f924-4a99-9474-e3557e391e45" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:44:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Lock "cinder-quobyte-8395a8e7-f924-4a99-9474-e3557e391e45" acquired by "delete_volume" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:44:09 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae143993-4531-4b5c-9786-c2836dfa51eb]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:44:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8395a8e7-f924-4a99-9474-e3557e391e45 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:44:09 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8395a8e7-f924-4a99-9474-e3557e391e45 Aug 09 12:44:09 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:44:10 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Aug 09 12:44:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8395a8e7-f924-4a99-9474-e3557e391e45" returned: 0 in 0.676s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:44:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8395a8e7-f924-4a99-9474-e3557e391e45 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:44:10 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8395a8e7-f924-4a99-9474-e3557e391e45 Aug 09 12:44:10 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:44:10 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Aug 09 12:44:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8395a8e7-f924-4a99-9474-e3557e391e45" returned: 0 in 0.576s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:44:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Lock "cinder-quobyte-8395a8e7-f924-4a99-9474-e3557e391e45" released by "delete_volume" :: held 1.309s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:44:10 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Created reservations ['d363180e-736b-4722-87be-897860b83298', '5a778e6a-cb77-455b-b4fa-9e572fde05b6', '5880ee58-66e0-4f7f-bdfa-2d1fbdca061d', 'c2116ce0-3588-4a89-a02d-00800f27056e'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:44:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:44:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:44:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:44:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:44:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:44:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:44:11 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:44:11 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:44:11 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Aug 09 12:44:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.342s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:44:11 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:44:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Deleted volume successfully. Aug 09 12:44:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5d82bb5a-d44b-40c0-bc20-fe7a18a3936d tempest-VolumesAdminNegativeTest-1276415830 None] Lock "cinder-8395a8e7-f924-4a99-9474-e3557e391e45-delete_volume" released by "delete_volume" :: held 2.010s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Flow 'volume_create_manager' (25766203-eb7d-4c76-8dfd-e84b352c47e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2f49e3-2fdf-4109-a98e-3e6822c35f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d2f49e3-2fdf-4109-a98e-3e6822c35f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1101051340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecba519-8884-4efd-909c-62bfa2790b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9693f86a774fb1bfe8a8c5f7c1e8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:44:16Z,use_quota=True,user_id='eed4cac4e1b0423b92f1360c04705857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3356421-4285-4a55-a31b-448d2d9466e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3356421-4285-4a55-a31b-448d2d9466e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b65197-3078-482b-922e-91f4aede3ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b65197-3078-482b-922e-91f4aede3ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ecba519-8884-4efd-909c-62bfa2790b30', 'volume_name': 'volume-9ecba519-8884-4efd-909c-62bfa2790b30', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073014bd-5d9d-4b19-9f3b-713a096dd405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (073014bd-5d9d-4b19-9f3b-713a096dd405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83772b68-6b4f-4c2c-bb38-e0ec9e13f829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:44:15 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Volume 9ecba519-8884-4efd-909c-62bfa2790b30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ecba519-8884-4efd-909c-62bfa2790b30', 'volume_size': 1} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1101051340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ecba519-8884-4efd-909c-62bfa2790b30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb9693f86a774fb1bfe8a8c5f7c1e8ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:44:16Z,use_quota=True,user_id='eed4cac4e1b0423b92f1360c04705857',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Creating volume 9ecba519-8884-4efd-909c-62bfa2790b30 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:44:15 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:44:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9ecba519-8884-4efd-909c-62bfa2790b30 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:44:15 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9ecba519-8884-4efd-909c-62bfa2790b30 1073741824 Aug 09 12:44:15 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:44:16 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Aug 09 12:44:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9ecba519-8884-4efd-909c-62bfa2790b30 1073741824" returned: 0 in 0.515s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:44:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9ecba519-8884-4efd-909c-62bfa2790b30 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:44:16 devstack sudo[92579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9ecba519-8884-4efd-909c-62bfa2790b30 Aug 09 12:44:16 devstack sudo[92579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:44:16 devstack sudo[92579]: pam_unix(sudo:session): session closed for user root Aug 09 12:44:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9ecba519-8884-4efd-909c-62bfa2790b30" returned: 0 in 0.490s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:44:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:44:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.078s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:44:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83772b68-6b4f-4c2c-bb38-e0ec9e13f829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ecba519-8884-4efd-909c-62bfa2790b30', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:44:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21498f6-6cba-459e-b7e8-140d2f9d9085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:44:16 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Volume volume-9ecba519-8884-4efd-909c-62bfa2790b30 (9ecba519-8884-4efd-909c-62bfa2790b30): created successfully Aug 09 12:44:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e21498f6-6cba-459e-b7e8-140d2f9d9085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:44:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Flow 'volume_create_manager' (25766203-eb7d-4c76-8dfd-e84b352c47e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:44:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5cc3c744-f02f-446c-8784-c3aa6cffea55 tempest-AttachVolumeShelveTestJSON-765345730 None] Created volume successfully. Aug 09 12:44:26 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=14,cinder:UPDATE=22,cinder:INSERT=7,cinder:DELETE=2 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:44:26 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=16,cinder:INSERT=3,cinder:UPDATE=22,cinder:DELETE=2 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:44:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-eb7b8c67-0abe-4e2e-9978-2215f2226e7c req-b139edab-6a3b-4406-b88a-6f8725589938 tempest-AttachVolumeShelveTestJSON-765345730 None] No connector for attachment 6c5f42a4-c1ad-4c49-b6c4-d51c1935b6d4; skipping storage backend terminate_connection call. {{(pid=89309) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Aug 09 12:44:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-eb7b8c67-0abe-4e2e-9978-2215f2226e7c req-b139edab-6a3b-4406-b88a-6f8725589938 tempest-AttachVolumeShelveTestJSON-765345730 None] Deleting attachment 6c5f42a4-c1ad-4c49-b6c4-d51c1935b6d4. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:44:43 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=1 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:44:43 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=1 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:44:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:44:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:44:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:44:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:44:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:44:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:44:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:44:57 devstack sudo[93082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:44:57 devstack sudo[93082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:44:58 devstack sudo[93082]: pam_unix(sudo:session): session closed for user root Aug 09 12:44:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.546s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:44:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:45:05 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:45:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Flow 'volume_create_manager' (0e6ea1be-1edd-42e4-b484-88ad4528e011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80bb31e3-0db2-4a70-8db7-e08f8181b09c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80bb31e3-0db2-4a70-8db7-e08f8181b09c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-285472853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381b0656-0e72-4614-9816-70b6699f9980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb76ae1ace441a1b962d6f0741a79be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:06Z,use_quota=True,user_id='f6555fc89cf744e992919ee3ba3f7710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3115fdba-d47b-4df6-bea3-354ef7f86709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3115fdba-d47b-4df6-bea3-354ef7f86709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193a0562-63bd-4a53-862f-7ecba97736b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (193a0562-63bd-4a53-862f-7ecba97736b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '381b0656-0e72-4614-9816-70b6699f9980', 'volume_name': 'volume-381b0656-0e72-4614-9816-70b6699f9980', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59011988-4408-4a5c-8a11-d52869807343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59011988-4408-4a5c-8a11-d52869807343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b28c5a-e8cb-4f63-abba-9dc2bbc4aba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:06 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Volume 381b0656-0e72-4614-9816-70b6699f9980: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-381b0656-0e72-4614-9816-70b6699f9980', 'volume_size': 1} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:45:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-285472853',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=381b0656-0e72-4614-9816-70b6699f9980,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb76ae1ace441a1b962d6f0741a79be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:06Z,use_quota=True,user_id='f6555fc89cf744e992919ee3ba3f7710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Creating volume 381b0656-0e72-4614-9816-70b6699f9980 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:45:06 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-381b0656-0e72-4614-9816-70b6699f9980 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:06 devstack sudo[93123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-381b0656-0e72-4614-9816-70b6699f9980 1073741824 Aug 09 12:45:06 devstack sudo[93123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:06 devstack sudo[93123]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-381b0656-0e72-4614-9816-70b6699f9980 1073741824" returned: 0 in 0.541s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-381b0656-0e72-4614-9816-70b6699f9980 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:06 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-381b0656-0e72-4614-9816-70b6699f9980 Aug 09 12:45:06 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:06 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-381b0656-0e72-4614-9816-70b6699f9980" returned: 0 in 0.316s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] <== create_volume: return (906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6b28c5a-e8cb-4f63-abba-9dc2bbc4aba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-381b0656-0e72-4614-9816-70b6699f9980', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073cd714-b886-41cf-8c14-d34419ca9191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:06 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Volume volume-381b0656-0e72-4614-9816-70b6699f9980 (381b0656-0e72-4614-9816-70b6699f9980): created successfully Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (073cd714-b886-41cf-8c14-d34419ca9191) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Flow 'volume_create_manager' (0e6ea1be-1edd-42e4-b484-88ad4528e011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:06 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-79246e3e-0e65-435b-9fcd-9b564bbf9db5 tempest-ServersNegativeTestJSON-563776338 None] Created volume successfully. Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Flow 'volume_create_manager' (23326476-2e75-461d-bd0e-4aa7b8c74e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3a1d8e-8e4c-42c3-934e-60ee53ac04af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc3a1d8e-8e4c-42c3-934e-60ee53ac04af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1419920595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4120750-3958-46eb-992c-e70a397bff0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb76ae1ace441a1b962d6f0741a79be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:11Z,use_quota=True,user_id='f6555fc89cf744e992919ee3ba3f7710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb18866d-99ba-483c-bd7a-5e22c3061007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb18866d-99ba-483c-bd7a-5e22c3061007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4316f9b1-9596-4393-90e6-a7d1033e358d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4316f9b1-9596-4393-90e6-a7d1033e358d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4120750-3958-46eb-992c-e70a397bff0c', 'volume_name': 'volume-c4120750-3958-46eb-992c-e70a397bff0c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdf9aaa-1634-49e5-90d9-e18955016344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cdf9aaa-1634-49e5-90d9-e18955016344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b440347-345f-4ba3-abd2-cfbbad10c4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:11 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Volume c4120750-3958-46eb-992c-e70a397bff0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4120750-3958-46eb-992c-e70a397bff0c', 'volume_size': 1} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:45:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1419920595',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4120750-3958-46eb-992c-e70a397bff0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dcb76ae1ace441a1b962d6f0741a79be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:11Z,use_quota=True,user_id='f6555fc89cf744e992919ee3ba3f7710',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Creating volume c4120750-3958-46eb-992c-e70a397bff0c {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:45:11 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:45:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c4120750-3958-46eb-992c-e70a397bff0c 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:11 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c4120750-3958-46eb-992c-e70a397bff0c 1073741824 Aug 09 12:45:11 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:12 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c4120750-3958-46eb-992c-e70a397bff0c 1073741824" returned: 0 in 1.181s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c4120750-3958-46eb-992c-e70a397bff0c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:12 devstack sudo[93283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c4120750-3958-46eb-992c-e70a397bff0c Aug 09 12:45:12 devstack sudo[93283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:13 devstack sudo[93283]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c4120750-3958-46eb-992c-e70a397bff0c" returned: 0 in 0.499s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:45:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.802s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b440347-345f-4ba3-abd2-cfbbad10c4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4120750-3958-46eb-992c-e70a397bff0c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0be778-be4e-41eb-b50d-e2ae082a3c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:13 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Volume volume-c4120750-3958-46eb-992c-e70a397bff0c (c4120750-3958-46eb-992c-e70a397bff0c): created successfully Aug 09 12:45:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d0be778-be4e-41eb-b50d-e2ae082a3c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Flow 'volume_create_manager' (23326476-2e75-461d-bd0e-4aa7b8c74e7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:13 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ecba0dc5-7e11-47da-a841-bc1a5ad9ee35 tempest-ServersNegativeTestJSON-563776338 None] Created volume successfully. Aug 09 12:45:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Acquiring lock "cinder-c4120750-3958-46eb-992c-e70a397bff0c-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:45:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Lock "cinder-c4120750-3958-46eb-992c-e70a397bff0c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:45:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Acquiring lock "cinder-quobyte-c4120750-3958-46eb-992c-e70a397bff0c" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:45:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Lock "cinder-quobyte-c4120750-3958-46eb-992c-e70a397bff0c" acquired by "delete_volume" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:45:14 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c5c96a-cec7-4ac2-ae4c-0cdfc14e3e6c]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:45:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c4120750-3958-46eb-992c-e70a397bff0c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:15 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c4120750-3958-46eb-992c-e70a397bff0c Aug 09 12:45:15 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:15 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c4120750-3958-46eb-992c-e70a397bff0c" returned: 0 in 0.664s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c4120750-3958-46eb-992c-e70a397bff0c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:15 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c4120750-3958-46eb-992c-e70a397bff0c Aug 09 12:45:15 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:16 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c4120750-3958-46eb-992c-e70a397bff0c" returned: 0 in 0.637s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Lock "cinder-quobyte-c4120750-3958-46eb-992c-e70a397bff0c" released by "delete_volume" :: held 1.402s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:45:16 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Created reservations ['1878dfd2-4795-4ee5-b8c3-243fc039229f', '805fe9b7-c33a-459f-a3c4-f2b8a02d3331', '86ac1dbe-a99b-4ee1-9f9b-6fa9a5fc0cd2', '206f7631-00f5-487d-b776-b60425bcb6b3'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:45:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:45:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:45:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:16 devstack sudo[93376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:45:16 devstack sudo[93376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:16 devstack sudo[93376]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.367s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:16 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:45:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Deleted volume successfully. Aug 09 12:45:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4bb5f6f3-87bc-4a0e-8781-7482515aba88 tempest-ServersNegativeTestJSON-563776338 None] Lock "cinder-c4120750-3958-46eb-992c-e70a397bff0c-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:45:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Acquiring lock "cinder-381b0656-0e72-4614-9816-70b6699f9980-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:45:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Lock "cinder-381b0656-0e72-4614-9816-70b6699f9980-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:45:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Acquiring lock "cinder-quobyte-381b0656-0e72-4614-9816-70b6699f9980" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:45:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Lock "cinder-quobyte-381b0656-0e72-4614-9816-70b6699f9980" acquired by "delete_volume" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:45:17 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3cfeb23-888d-472d-8bab-5557d4e4ce4f]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:45:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-381b0656-0e72-4614-9816-70b6699f9980 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:17 devstack sudo[93398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-381b0656-0e72-4614-9816-70b6699f9980 Aug 09 12:45:17 devstack sudo[93398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:18 devstack sudo[93398]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-381b0656-0e72-4614-9816-70b6699f9980" returned: 0 in 0.592s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-381b0656-0e72-4614-9816-70b6699f9980 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:18 devstack sudo[93404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-381b0656-0e72-4614-9816-70b6699f9980 Aug 09 12:45:18 devstack sudo[93404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:18 devstack sudo[93404]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-381b0656-0e72-4614-9816-70b6699f9980" returned: 0 in 0.643s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Lock "cinder-quobyte-381b0656-0e72-4614-9816-70b6699f9980" released by "delete_volume" :: held 1.335s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:45:18 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Created reservations ['191fea42-8c9a-4f89-9d09-b7573adfe5fb', 'b296060d-20e5-4826-b9e3-061b91bedf9d', '9d37fafd-d071-4831-a626-cab0322f0514', '0aac30e5-2b64-4dcd-ac40-f688678524c6'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:45:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:45:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:45:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:19 devstack sudo[93408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:45:19 devstack sudo[93408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:19 devstack sudo[93408]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.873s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:19 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:45:19 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Deleted volume successfully. Aug 09 12:45:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bfb27a90-886a-4f61-b6fa-fc0a5fa18cdb tempest-ServersNegativeTestJSON-563776338 None] Lock "cinder-381b0656-0e72-4614-9816-70b6699f9980-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:45:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Acquiring lock "cinder-9ecba519-8884-4efd-909c-62bfa2790b30-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:45:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Lock "cinder-9ecba519-8884-4efd-909c-62bfa2790b30-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:45:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Acquiring lock "cinder-quobyte-9ecba519-8884-4efd-909c-62bfa2790b30" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:45:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Lock "cinder-quobyte-9ecba519-8884-4efd-909c-62bfa2790b30" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:45:24 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[04be8b69-b812-4d6e-b93a-1890d6c0d585]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:45:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9ecba519-8884-4efd-909c-62bfa2790b30 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:25 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9ecba519-8884-4efd-909c-62bfa2790b30 Aug 09 12:45:25 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:25 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9ecba519-8884-4efd-909c-62bfa2790b30" returned: 0 in 0.758s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9ecba519-8884-4efd-909c-62bfa2790b30 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:25 devstack sudo[93460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9ecba519-8884-4efd-909c-62bfa2790b30 Aug 09 12:45:25 devstack sudo[93460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:26 devstack sudo[93460]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9ecba519-8884-4efd-909c-62bfa2790b30" returned: 0 in 0.331s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Lock "cinder-quobyte-9ecba519-8884-4efd-909c-62bfa2790b30" released by "delete_volume" :: held 1.181s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:45:26 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Created reservations ['ef9060f8-133b-47d7-818a-e240749f964c', '709dacfa-1913-4294-ad58-083d20405e24', '38b65873-c8d4-4593-a12e-24724e7aacad', '53f6bda2-b2bd-439a-b3c3-fadce46202bf'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:45:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:45:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:45:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:26 devstack sudo[93463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:45:26 devstack sudo[93463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:26 devstack sudo[93463]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.400s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:26 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:45:26 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Deleted volume successfully. Aug 09 12:45:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b7d3014-afec-4dd4-b18d-3728b0a82625 tempest-AttachVolumeShelveTestJSON-765345730 None] Lock "cinder-9ecba519-8884-4efd-909c-62bfa2790b30-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:45:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8de179f0-d600-4f9b-9f95-657e52b45d19 tempest-BackendsCapabilitiesAdminTestsJSON-1157020474 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576332092285, 'free_capacity_gb': 1775.7576332092285, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89309) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 09 12:45:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a5e26dd8-3beb-4089-8b50-3309e4f15c74 tempest-BackendsCapabilitiesAdminTestsJSON-1157020474 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576332092285, 'free_capacity_gb': 1775.7576332092285, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89309) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Flow 'volume_create_manager' (f6bc3d5a-6541-4a86-b872-6f058e193b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0af88db-20a8-42fe-a31c-9281eab876a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0af88db-20a8-42fe-a31c-9281eab876a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1350649009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a646f1-3474-49e2-a9bc-1ae4ff37937c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cd071ab442c74e19afbfa85b96e1ec62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:37Z,use_quota=True,user_id='2ec9ab25450a430daa33b72ea41ee845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c2a3cb-1bd8-4faa-8c64-82680bbdaabc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92c2a3cb-1bd8-4faa-8c64-82680bbdaabc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa74608-845a-41aa-8f1d-e7821956965e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fa74608-845a-41aa-8f1d-e7821956965e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70a646f1-3474-49e2-a9bc-1ae4ff37937c', 'volume_name': 'volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638d57e0-57f3-488b-9255-925a7c90332a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (638d57e0-57f3-488b-9255-925a7c90332a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1dc797-2251-4bef-8c7d-5ce9340bb8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:37 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Volume 70a646f1-3474-49e2-a9bc-1ae4ff37937c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c', 'volume_size': 1} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:45:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1350649009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70a646f1-3474-49e2-a9bc-1ae4ff37937c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='cd071ab442c74e19afbfa85b96e1ec62',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:37Z,use_quota=True,user_id='2ec9ab25450a430daa33b72ea41ee845',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Creating volume 70a646f1-3474-49e2-a9bc-1ae4ff37937c {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:45:37 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:45:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:37 devstack sudo[93569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c 1073741824 Aug 09 12:45:37 devstack sudo[93569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:38 devstack sudo[93569]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c 1073741824" returned: 0 in 0.574s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:38 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c Aug 09 12:45:38 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:38 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c" returned: 0 in 0.299s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:45:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb1dc797-2251-4bef-8c7d-5ce9340bb8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db809557-93aa-4ddf-b832-f2c81a23143b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:38 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Volume volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c (70a646f1-3474-49e2-a9bc-1ae4ff37937c): created successfully Aug 09 12:45:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db809557-93aa-4ddf-b832-f2c81a23143b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Flow 'volume_create_manager' (f6bc3d5a-6541-4a86-b872-6f058e193b67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:38 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-8d3256e8-0090-464a-98a7-1655095e43d0 req-ee40253c-c0b2-4c97-ba47-8cc9d61bbf66 tempest-VolumesGetTestJSON-635515211 None] Created volume successfully. Aug 09 12:45:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Acquiring lock "cinder-70a646f1-3474-49e2-a9bc-1ae4ff37937c-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:45:40 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2619a56a-2b2d-42e3-9630-8e19582b3773 tempest-GroupSnapshotsV319Test-2061888119 None] Group tempest-GroupSnapshotsV319Test-Group-1578302967: creating Aug 09 12:45:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Lock "cinder-70a646f1-3474-49e2-a9bc-1ae4ff37937c-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:45:40 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2619a56a-2b2d-42e3-9630-8e19582b3773 tempest-GroupSnapshotsV319Test-2061888119 None] Group tempest-GroupSnapshotsV319Test-Group-1578302967: created successfully Aug 09 12:45:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Acquiring lock "cinder-quobyte-70a646f1-3474-49e2-a9bc-1ae4ff37937c" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:45:40 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2619a56a-2b2d-42e3-9630-8e19582b3773 tempest-GroupSnapshotsV319Test-2061888119 None] Create group completed successfully. Aug 09 12:45:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Lock "cinder-quobyte-70a646f1-3474-49e2-a9bc-1ae4ff37937c" acquired by "delete_volume" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:45:40 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[551d42f1-15f4-4f29-84c9-fa0ff5fa2a02]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:45:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:40 devstack sudo[93580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c Aug 09 12:45:40 devstack sudo[93580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:40 devstack sudo[93580]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c" returned: 0 in 0.368s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:40 devstack sudo[93585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c Aug 09 12:45:40 devstack sudo[93585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:40 devstack sudo[93585]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70a646f1-3474-49e2-a9bc-1ae4ff37937c" returned: 0 in 0.244s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Lock "cinder-quobyte-70a646f1-3474-49e2-a9bc-1ae4ff37937c" released by "delete_volume" :: held 0.649s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.quota [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Created reservations ['183c1333-70a5-4e3d-85a8-c0fb42b3f86b', '3272bfd0-2732-4e75-a102-1577f159d2cb', '0c7233ff-ad75-4f0d-8bc2-596e6e6f83b4', 'e9fe328d-319c-417d-9164-016e483adef2'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:41 devstack sudo[93588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:45:41 devstack sudo[93588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:41 devstack sudo[93588]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.271s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.manager [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:45:41 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Deleted volume successfully. Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-c5ca4641-a263-4bd2-aba9-cfb3c887ba31 req-43ecdbe9-b575-4807-b74e-32763d9df01c tempest-VolumesGetTestJSON-635515211 None] Lock "cinder-70a646f1-3474-49e2-a9bc-1ae4ff37937c-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Flow 'volume_create_manager' (ef69bc4c-1476-45e6-a854-d29f599ea061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3783edf-8adf-4ca4-852f-b332f0968044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3783edf-8adf-4ca4-852f-b332f0968044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1999387043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd84b1ca-0550-4925-a8d1-7aceada01714,host='devstack@QuobyteHD#QuobyteHD',id=a272b0ae-8a42-4ea2-bdd1-20ff40a14292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e596a04edfa841ca834b7aa9f93e2df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:42Z,use_quota=True,user_id='7e0a018a334b4750acf5d275605b78c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea824dbf-41cc-406a-a082-f59f97202a9e),volume_type_id=ea824dbf-41cc-406a-a082-f59f97202a9e)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294ca9b8-cf69-4bed-a545-d47d7cb5f07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (294ca9b8-cf69-4bed-a545-d47d7cb5f07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4be4bb7-f2f6-423d-8363-08e359bf3a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4be4bb7-f2f6-423d-8363-08e359bf3a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a272b0ae-8a42-4ea2-bdd1-20ff40a14292', 'volume_name': 'volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc924455-b6c0-45bf-9d34-212c0d63796e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc924455-b6c0-45bf-9d34-212c0d63796e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c365edb-d622-4498-b22b-fb6bf9d0dfe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:41 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Volume a272b0ae-8a42-4ea2-bdd1-20ff40a14292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292', 'volume_size': 1} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bd84b1ca-0550-4925-a8d1-7aceada01714,created_at=2026-08-09T10:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1999387043',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bd84b1ca-0550-4925-a8d1-7aceada01714,host='devstack@QuobyteHD#QuobyteHD',id=a272b0ae-8a42-4ea2-bdd1-20ff40a14292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e596a04edfa841ca834b7aa9f93e2df9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:42Z,use_quota=True,user_id='7e0a018a334b4750acf5d275605b78c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea824dbf-41cc-406a-a082-f59f97202a9e),volume_type_id=ea824dbf-41cc-406a-a082-f59f97202a9e)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Creating volume a272b0ae-8a42-4ea2-bdd1-20ff40a14292 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:45:41 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:45:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:42 devstack sudo[93593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 1073741824 Aug 09 12:45:42 devstack sudo[93593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:42 devstack sudo[93593]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 1073741824" returned: 0 in 0.530s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:42 devstack sudo[93599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 Aug 09 12:45:42 devstack sudo[93599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Flow 'volume_create_manager' (72e36d1a-2dc2-4647-aadf-0749ef8933e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf77099-7a5e-44f1-ba23-8a2369de28c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aaf77099-7a5e-44f1-ba23-8a2369de28c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-400627588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b1ff99-f7a9-43e6-8204-306b423777a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd8264699f64ce9b650776ae66448e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:43Z,use_quota=True,user_id='e039d7ef77c34c84bc4b789c8242d787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27f0688-2bd2-4089-b2a2-600b9587485e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c27f0688-2bd2-4089-b2a2-600b9587485e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c44172-b19c-44b2-9071-49860bc4287b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c44172-b19c-44b2-9071-49860bc4287b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14b1ff99-f7a9-43e6-8204-306b423777a6', 'volume_name': 'volume-14b1ff99-f7a9-43e6-8204-306b423777a6', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4225018-71c3-4e1b-be80-28098d666b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4225018-71c3-4e1b-be80-28098d666b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0093baf-f820-41c3-95fa-320c56143842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:42 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Volume 14b1ff99-f7a9-43e6-8204-306b423777a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14b1ff99-f7a9-43e6-8204-306b423777a6', 'volume_size': 1} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:42 devstack sudo[93599]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292" returned: 0 in 0.418s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] <== create_volume: return (997ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.022s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-400627588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14b1ff99-f7a9-43e6-8204-306b423777a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd8264699f64ce9b650776ae66448e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:43Z,use_quota=True,user_id='e039d7ef77c34c84bc4b789c8242d787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Creating volume 14b1ff99-f7a9-43e6-8204-306b423777a6 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:45:42 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:45:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-14b1ff99-f7a9-43e6-8204-306b423777a6 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:43 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-14b1ff99-f7a9-43e6-8204-306b423777a6 1073741824 Aug 09 12:45:43 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c365edb-d622-4498-b22b-fb6bf9d0dfe0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f84972-8974-4b70-a2a3-255dee900c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:43 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Volume volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 (a272b0ae-8a42-4ea2-bdd1-20ff40a14292): created successfully Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3f84972-8974-4b70-a2a3-255dee900c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Flow 'volume_create_manager' (ef69bc4c-1476-45e6-a854-d29f599ea061) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:43 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b4bc6f09-b2cb-42f1-a785-720c640a2e67 tempest-GroupSnapshotsV319Test-2061888119 None] Created volume successfully. Aug 09 12:45:43 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-14b1ff99-f7a9-43e6-8204-306b423777a6 1073741824" returned: 0 in 0.648s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-14b1ff99-f7a9-43e6-8204-306b423777a6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:43 devstack sudo[93611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-14b1ff99-f7a9-43e6-8204-306b423777a6 Aug 09 12:45:43 devstack sudo[93611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Flow 'volume_create_manager' (1ca60595-d490-4c5e-b132-b213c84287f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e40cbf1-0ec1-4b3c-9a25-26cf7d807fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e40cbf1-0ec1-4b3c-9a25-26cf7d807fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-333665323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648cc8e9-bb21-4419-a317-65e05a03af4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3e2a27f1bb44ddb33f9226314ee37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:44Z,use_quota=True,user_id='948a08f0d2a6498c9fac003cd8969ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d0f399-c203-41a6-a9a0-b715d786cfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8d0f399-c203-41a6-a9a0-b715d786cfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09aa79f9-d570-40ff-9ae9-1d35b12e9af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09aa79f9-d570-40ff-9ae9-1d35b12e9af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '648cc8e9-bb21-4419-a317-65e05a03af4a', 'volume_name': 'volume-648cc8e9-bb21-4419-a317-65e05a03af4a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e8ad39-7ac6-48c3-aee8-d8965a697bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e8ad39-7ac6-48c3-aee8-d8965a697bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3a6385-e14c-4224-b909-746a60f73a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:43 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Volume 648cc8e9-bb21-4419-a317-65e05a03af4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-648cc8e9-bb21-4419-a317-65e05a03af4a', 'volume_size': 1} Aug 09 12:45:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:44 devstack sudo[93611]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-14b1ff99-f7a9-43e6-8204-306b423777a6" returned: 0 in 0.329s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.143s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:45:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-333665323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=648cc8e9-bb21-4419-a317-65e05a03af4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3e2a27f1bb44ddb33f9226314ee37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:44Z,use_quota=True,user_id='948a08f0d2a6498c9fac003cd8969ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Creating volume 648cc8e9-bb21-4419-a317-65e05a03af4a {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:45:44 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-648cc8e9-bb21-4419-a317-65e05a03af4a 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0093baf-f820-41c3-95fa-320c56143842) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14b1ff99-f7a9-43e6-8204-306b423777a6', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849daa51-3b46-4a0a-b624-485094acc39a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:44 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-648cc8e9-bb21-4419-a317-65e05a03af4a 1073741824 Aug 09 12:45:44 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:44 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Volume volume-14b1ff99-f7a9-43e6-8204-306b423777a6 (14b1ff99-f7a9-43e6-8204-306b423777a6): created successfully Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (849daa51-3b46-4a0a-b624-485094acc39a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Flow 'volume_create_manager' (72e36d1a-2dc2-4647-aadf-0749ef8933e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-655e7ce8-b16f-4743-b66b-6128efb5d6ba tempest-ServerActionsTestOtherA-978128034 None] Created volume successfully. Aug 09 12:45:44 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-648cc8e9-bb21-4419-a317-65e05a03af4a 1073741824" returned: 0 in 0.575s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-648cc8e9-bb21-4419-a317-65e05a03af4a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:44 devstack sudo[93620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-648cc8e9-bb21-4419-a317-65e05a03af4a Aug 09 12:45:44 devstack sudo[93620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] GroupSnapshot 3ed9e7bc-1c3b-416a-b4ec-67e916b5d458: creating. Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] Group snapshot 3ed9e7bc-1c3b-416a-b4ec-67e916b5d458: creating. {{(pid=89309) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:44 devstack sudo[93620]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-648cc8e9-bb21-4419-a317-65e05a03af4a" returned: 0 in 0.336s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.117s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] Creating offline snapshot c8312408-4f85-4ad5-80e7-70f437b50ca2 of volume a272b0ae-8a42-4ea2-bdd1-20ff40a14292 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:45:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3a6385-e14c-4224-b909-746a60f73a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-648cc8e9-bb21-4419-a317-65e05a03af4a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb70f0f-9871-44a7-8d55-c001f3b290a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:45 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa4991a-968c-4fb0-a2b7-5f9d133d0498]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:45:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:45 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Volume volume-648cc8e9-bb21-4419-a317-65e05a03af4a (648cc8e9-bb21-4419-a317-65e05a03af4a): created successfully Aug 09 12:45:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcb70f0f-9871-44a7-8d55-c001f3b290a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Flow 'volume_create_manager' (1ca60595-d490-4c5e-b132-b213c84287f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:45 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b75019f8-5144-4d52-97f4-ed9f282094c0 tempest-AttachVolumeTestJSON-1680535427 None] Created volume successfully. Aug 09 12:45:45 devstack sudo[93623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 Aug 09 12:45:45 devstack sudo[93623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:45 devstack sudo[93623]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292" returned: 0 in 0.413s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:45 devstack sudo[93629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 1G Aug 09 12:45:45 devstack sudo[93629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:45 devstack sudo[93629]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 1G" returned: 0 in 0.438s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:45 devstack sudo[93635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 Aug 09 12:45:45 devstack sudo[93635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:46 devstack sudo[93635]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2" returned: 0 in 0.368s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:46 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:45:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:46 devstack sudo[93649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 Aug 09 12:45:46 devstack sudo[93649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:46 devstack sudo[93649]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2" returned: 0 in 0.382s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:46 devstack sudo[93653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.info Aug 09 12:45:46 devstack sudo[93653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:47 devstack sudo[93653]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.info" returned: 0 in 0.345s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:47 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.info is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:45:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:47 devstack sudo[93656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.info Aug 09 12:45:47 devstack sudo[93656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:47 devstack sudo[93656]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.info" returned: 0 in 0.343s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.426s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-ff00ac54-aff1-462f-8c12-3d206daa2efb req-bc9c1418-56c8-4db6-a77b-1c65c76fc147 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-ff00ac54-aff1-462f-8c12-3d206daa2efb req-bc9c1418-56c8-4db6-a77b-1c65c76fc147 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-ff00ac54-aff1-462f-8c12-3d206daa2efb req-bc9c1418-56c8-4db6-a77b-1c65c76fc147 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-ff00ac54-aff1-462f-8c12-3d206daa2efb req-bc9c1418-56c8-4db6-a77b-1c65c76fc147 tempest-AttachVolumeTestJSON-1680535427 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-648cc8e9-bb21-4419-a317-65e05a03af4a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2e348795-8e8c-498d-9dee-9406716e2a53', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:45:47 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1e4be49e-4f18-4c1d-86ac-f35f9445d348 tempest-GroupSnapshotsV319Test-2061888119 None] group_snapshot 3ed9e7bc-1c3b-416a-b4ec-67e916b5d458: created successfully Aug 09 12:45:47 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-ff00ac54-aff1-462f-8c12-3d206daa2efb req-bc9c1418-56c8-4db6-a77b-1c65c76fc147 tempest-AttachVolumeTestJSON-1680535427 None] attachment_update completed successfully. Aug 09 12:45:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] group_snapshot 3ed9e7bc-1c3b-416a-b4ec-67e916b5d458: deleting Aug 09 12:45:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] group_snapshot 3ed9e7bc-1c3b-416a-b4ec-67e916b5d458: deleting {{(pid=89309) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 09 12:45:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Acquiring lock "cinder-quobyte-a272b0ae-8a42-4ea2-bdd1-20ff40a14292" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:45:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "cinder-quobyte-a272b0ae-8a42-4ea2-bdd1-20ff40a14292" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:45:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Acquiring lock "cinder-quobyte-c8312408-4f85-4ad5-80e7-70f437b50ca2" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:45:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "cinder-quobyte-c8312408-4f85-4ad5-80e7-70f437b50ca2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:45:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Deleting offline snapshot c8312408-4f85-4ad5-80e7-70f437b50ca2 of volume a272b0ae-8a42-4ea2-bdd1-20ff40a14292 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:45:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] snapshot_file for this snap is: volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:45:49 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8390808-93cc-4d5e-b4eb-1567c31aff42]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:45:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:49 devstack sudo[94067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 Aug 09 12:45:49 devstack sudo[94067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:49 devstack sudo[94067]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2" returned: 0 in 0.542s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:45:49 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4273ccdc-2e80-476c-b1d5-40dc52c2ed5c]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:45:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:49 devstack sudo[94078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 Aug 09 12:45:49 devstack sudo[94078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:50 devstack sudo[94078]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292" returned: 0 in 0.526s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:50 devstack sudo[94083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 Aug 09 12:45:50 devstack sudo[94083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Flow 'volume_create_manager' (4afdf68a-7266-4562-9109-87d12368e87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab0723d-9618-4b17-b194-5ca34e604d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ab0723d-9618-4b17-b194-5ca34e604d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-437617574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e7077c-ce3f-4ae9-8119-760fda835538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3e2a27f1bb44ddb33f9226314ee37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:50Z,use_quota=True,user_id='948a08f0d2a6498c9fac003cd8969ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:50 devstack sudo[94083]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ccab0e-b779-4ad4-a290-17a9186b689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ccab0e-b779-4ad4-a290-17a9186b689f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2196ddc-6631-4687-9d8a-287916c8c46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2196ddc-6631-4687-9d8a-287916c8c46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73e7077c-ce3f-4ae9-8119-760fda835538', 'volume_name': 'volume-73e7077c-ce3f-4ae9-8119-760fda835538', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7845c551-43f4-41bd-ad87-8413e355c796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7845c551-43f4-41bd-ad87-8413e355c796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69633fa5-8d07-426a-ac99-b27f9311ab99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:50 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Volume 73e7077c-ce3f-4ae9-8119-760fda835538: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73e7077c-ce3f-4ae9-8119-760fda835538', 'volume_size': 1} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-437617574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73e7077c-ce3f-4ae9-8119-760fda835538,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd3e2a27f1bb44ddb33f9226314ee37f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:45:50Z,use_quota=True,user_id='948a08f0d2a6498c9fac003cd8969ec2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Creating volume 73e7077c-ce3f-4ae9-8119-760fda835538 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:45:50 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73e7077c-ce3f-4ae9-8119-760fda835538 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2" returned: 0 in 0.511s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:50 devstack sudo[94089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73e7077c-ce3f-4ae9-8119-760fda835538 1073741824 Aug 09 12:45:50 devstack sudo[94089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:50 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2 Aug 09 12:45:50 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:50 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292.c8312408-4f85-4ad5-80e7-70f437b50ca2" returned: 0 in 0.322s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "cinder-quobyte-c8312408-4f85-4ad5-80e7-70f437b50ca2" released by "_delete_snapshot" :: held 2.062s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "cinder-quobyte-a272b0ae-8a42-4ea2-bdd1-20ff40a14292" released by "delete_snapshot" :: held 2.096s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:45:51 devstack cinder-volume[89309]: WARNING cinder.quota [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1489944531 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1489944531, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:45:51 devstack cinder-volume[89309]: WARNING cinder.quota [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1489944531 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1489944531, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] Created reservations ['46fb334a-3584-4396-9ed3-73676454d104', 'f6820dd2-e543-41d1-af08-83c7e30a4b57', 'cfec00fe-e620-4484-92d6-304552e35c1e', '9ad933ca-1d11-4316-8a3e-18006dd135a3'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:45:51 devstack sudo[94089]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73e7077c-ce3f-4ae9-8119-760fda835538 1073741824" returned: 0 in 0.570s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:51 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-68d8a33f-a49a-4295-8b20-bb2f3a042bb3 tempest-GroupSnapshotsV319Test-2061888119 None] group_snapshot 3ed9e7bc-1c3b-416a-b4ec-67e916b5d458: deleted successfully Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73e7077c-ce3f-4ae9-8119-760fda835538 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:51 devstack sudo[94102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73e7077c-ce3f-4ae9-8119-760fda835538 Aug 09 12:45:51 devstack sudo[94102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:51 devstack sudo[94102]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73e7077c-ce3f-4ae9-8119-760fda835538" returned: 0 in 0.356s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69633fa5-8d07-426a-ac99-b27f9311ab99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73e7077c-ce3f-4ae9-8119-760fda835538', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c41e296-99b5-4d56-acb5-b29964d21cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:45:51 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Volume volume-73e7077c-ce3f-4ae9-8119-760fda835538 (73e7077c-ce3f-4ae9-8119-760fda835538): created successfully Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c41e296-99b5-4d56-acb5-b29964d21cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Flow 'volume_create_manager' (4afdf68a-7266-4562-9109-87d12368e87d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:45:51 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-0d8d486a-b068-42eb-8646-fc078517847a tempest-AttachVolumeTestJSON-1680535427 None] Created volume successfully. Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Acquiring lock "cinder-quobyte-a272b0ae-8a42-4ea2-bdd1-20ff40a14292" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "cinder-quobyte-a272b0ae-8a42-4ea2-bdd1-20ff40a14292" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c909833e-23ff-4cd2-bb3c-799f7db9c73b]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:45:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:52 devstack sudo[94109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 Aug 09 12:45:52 devstack sudo[94109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:52 devstack sudo[94109]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292" returned: 0 in 0.783s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:52 devstack sudo[94141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292 Aug 09 12:45:52 devstack sudo[94141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:53 devstack sudo[94141]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a272b0ae-8a42-4ea2-bdd1-20ff40a14292" returned: 0 in 0.504s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "cinder-quobyte-a272b0ae-8a42-4ea2-bdd1-20ff40a14292" released by "delete_volume" :: held 1.381s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:45:53 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Created reservations ['9d78cabb-8c4f-4019-ad9c-8fb06e3e238e'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:45:53 devstack cinder-volume[89309]: WARNING cinder.quota [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1489944531 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1489944531, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:45:53 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Created reservations ['320d19e6-3fd9-49c2-a7a6-48eaf566d613', 'eb97e3a5-6829-46ac-866f-6478416c0fc9', 'be2c9b07-a72a-4070-9698-ef48fc0e555f', 'aa84324f-1fa8-455f-9f60-b874b5c5a1bc'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:45:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:45:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:45:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:53 devstack sudo[94164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:45:53 devstack sudo[94164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:53 devstack sudo[94164]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.309s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:53 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:45:53 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-9619420f-f88c-475c-b662-7180582710d7 tempest-GroupSnapshotsV319Test-2061888119 None] Delete group completed successfully. Aug 09 12:45:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-fc6af74e-e5f4-49c5-98e9-8afecd688056 req-870d7afa-f8df-4cfd-81be-07fa4978773c tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-fc6af74e-e5f4-49c5-98e9-8afecd688056 req-870d7afa-f8df-4cfd-81be-07fa4978773c tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-fc6af74e-e5f4-49c5-98e9-8afecd688056 req-870d7afa-f8df-4cfd-81be-07fa4978773c tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-fc6af74e-e5f4-49c5-98e9-8afecd688056 req-870d7afa-f8df-4cfd-81be-07fa4978773c tempest-AttachVolumeTestJSON-1680535427 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-73e7077c-ce3f-4ae9-8119-760fda835538', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '41c804eb-33dd-4493-96fa-6c28da20bd60', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:45:54 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-fc6af74e-e5f4-49c5-98e9-8afecd688056 req-870d7afa-f8df-4cfd-81be-07fa4978773c tempest-AttachVolumeTestJSON-1680535427 None] attachment_update completed successfully. Aug 09 12:45:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:45:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:45:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:45:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:45:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:45:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:45:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:45:57 devstack sudo[94206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:45:57 devstack sudo[94206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:45:57 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-3232fd76-9036-4b4f-bc46-3160ee7ed059 req-90899b04-2130-494e-9771-1a20bd3984c9 tempest-AttachVolumeTestJSON-1680535427 None] Terminate volume connection completed successfully. Aug 09 12:45:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-3232fd76-9036-4b4f-bc46-3160ee7ed059 req-90899b04-2130-494e-9771-1a20bd3984c9 tempest-AttachVolumeTestJSON-1680535427 None] Deleting attachment 2e348795-8e8c-498d-9dee-9406716e2a53. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:45:58 devstack sudo[94206]: pam_unix(sudo:session): session closed for user root Aug 09 12:45:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.695s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:45:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:45:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:45:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 8 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:45:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:46:00 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-f3398a6b-71a5-42dc-aa66-f00728c48f11 req-eab99372-7a68-49df-a9b2-b5ea3235e508 tempest-AttachVolumeTestJSON-1680535427 None] Terminate volume connection completed successfully. Aug 09 12:46:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-f3398a6b-71a5-42dc-aa66-f00728c48f11 req-eab99372-7a68-49df-a9b2-b5ea3235e508 tempest-AttachVolumeTestJSON-1680535427 None] Deleting attachment 41c804eb-33dd-4493-96fa-6c28da20bd60. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:46:05 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=79,cinder:SELECT=69,cinder:INSERT=19,cinder:DELETE=8 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:46:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-dedff1e9-24e1-4591-845b-7a953e85b0f7 tempest-GroupsV314Test-1972928626 None] Group tempest-GroupsV314Test-Group-1170039363: creating Aug 09 12:46:05 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=77,cinder:UPDATE=74,cinder:DELETE=3,cinder:INSERT=14 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:46:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-dedff1e9-24e1-4591-845b-7a953e85b0f7 tempest-GroupsV314Test-1972928626 None] Group tempest-GroupsV314Test-Group-1170039363: created successfully Aug 09 12:46:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-dedff1e9-24e1-4591-845b-7a953e85b0f7 tempest-GroupsV314Test-1972928626 None] Create group completed successfully. Aug 09 12:46:06 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:46:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Flow 'volume_create_manager' (b805376c-5869-4845-87f6-0db5f3e75322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:46:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386da653-a11e-4fef-beb0-2c57093e065c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (386da653-a11e-4fef-beb0-2c57093e065c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-121764883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa62f202-6fc9-4cd5-bc09-4e4bc6603da2,host='devstack@QuobyteHD#QuobyteHD',id=802d4d4b-82a9-4913-902b-25c5e5ef034b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29dcfbe7eea43f1a7f1bd258a6b295a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:46:07Z,use_quota=True,user_id='bf2fcf2565244e2f82d4e4268f57b583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cf16ee3-b473-49e0-a07f-317685bfb6e6),volume_type_id=3cf16ee3-b473-49e0-a07f-317685bfb6e6)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab81148-568f-4890-8658-940a5abaa3ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ab81148-568f-4890-8658-940a5abaa3ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3fd168-a678-421b-9eb3-7d10a4109856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3fd168-a678-421b-9eb3-7d10a4109856) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '802d4d4b-82a9-4913-902b-25c5e5ef034b', 'volume_name': 'volume-802d4d4b-82a9-4913-902b-25c5e5ef034b', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a675fa44-b09b-4503-b03f-6ee845afa454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a675fa44-b09b-4503-b03f-6ee845afa454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48f97e3-2796-459e-93de-5580f2628e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:46:07 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Volume 802d4d4b-82a9-4913-902b-25c5e5ef034b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-802d4d4b-82a9-4913-902b-25c5e5ef034b', 'volume_size': 1} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aa62f202-6fc9-4cd5-bc09-4e4bc6603da2,created_at=2026-08-09T10:46:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-121764883',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa62f202-6fc9-4cd5-bc09-4e4bc6603da2,host='devstack@QuobyteHD#QuobyteHD',id=802d4d4b-82a9-4913-902b-25c5e5ef034b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f29dcfbe7eea43f1a7f1bd258a6b295a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:46:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:46:07Z,use_quota=True,user_id='bf2fcf2565244e2f82d4e4268f57b583',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cf16ee3-b473-49e0-a07f-317685bfb6e6),volume_type_id=3cf16ee3-b473-49e0-a07f-317685bfb6e6)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Creating volume 802d4d4b-82a9-4913-902b-25c5e5ef034b {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:46:07 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:07 devstack sudo[94274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b 1073741824 Aug 09 12:46:07 devstack sudo[94274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "cinder-73e7077c-ce3f-4ae9-8119-760fda835538-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Lock "cinder-73e7077c-ce3f-4ae9-8119-760fda835538-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "cinder-quobyte-73e7077c-ce3f-4ae9-8119-760fda835538" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Lock "cinder-quobyte-73e7077c-ce3f-4ae9-8119-760fda835538" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[93065922-230b-4cd5-98d9-637067466c26]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73e7077c-ce3f-4ae9-8119-760fda835538 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:07 devstack sudo[94274]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b 1073741824" returned: 0 in 0.714s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:07 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b Aug 09 12:46:07 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:07 devstack sudo[94294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73e7077c-ce3f-4ae9-8119-760fda835538 Aug 09 12:46:07 devstack sudo[94294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:08 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b" returned: 0 in 0.396s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] <== create_volume: return (1202ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48f97e3-2796-459e-93de-5580f2628e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-802d4d4b-82a9-4913-902b-25c5e5ef034b', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b64a2ce-627a-4c0c-90ea-d1119d8e89c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:46:08 devstack sudo[94294]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73e7077c-ce3f-4ae9-8119-760fda835538" returned: 0 in 0.541s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73e7077c-ce3f-4ae9-8119-760fda835538 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:08 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Volume volume-802d4d4b-82a9-4913-902b-25c5e5ef034b (802d4d4b-82a9-4913-902b-25c5e5ef034b): created successfully Aug 09 12:46:08 devstack sudo[94318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73e7077c-ce3f-4ae9-8119-760fda835538 Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b64a2ce-627a-4c0c-90ea-d1119d8e89c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:46:08 devstack sudo[94318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Flow 'volume_create_manager' (b805376c-5869-4845-87f6-0db5f3e75322) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:46:08 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f89e6c64-fc7a-4a9d-8543-f0912024995f tempest-GroupsV314Test-1972928626 None] Created volume successfully. Aug 09 12:46:08 devstack sudo[94318]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73e7077c-ce3f-4ae9-8119-760fda835538" returned: 0 in 0.262s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Lock "cinder-quobyte-73e7077c-ce3f-4ae9-8119-760fda835538" released by "delete_volume" :: held 0.890s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Created reservations ['68a782b4-4f20-457a-8f3f-e36a0e31bd04', '1e152e16-4f50-4e6c-a18c-9989f95939f7', '906a0963-4db7-4a75-bc1f-a87f5ef3db76', '3b8eed90-631d-4df0-bcd6-fcadcdb09a3e'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:08 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:46:08 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "cinder-648cc8e9-bb21-4419-a317-65e05a03af4a-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Lock "cinder-648cc8e9-bb21-4419-a317-65e05a03af4a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "cinder-quobyte-648cc8e9-bb21-4419-a317-65e05a03af4a" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Lock "cinder-quobyte-648cc8e9-bb21-4419-a317-65e05a03af4a" acquired by "delete_volume" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f07550-df72-4be1-baf3-67f1f7eb7606]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:46:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-648cc8e9-bb21-4419-a317-65e05a03af4a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:09 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.309s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:46:09 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Deleted volume successfully. Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-20e44b93-eb94-4bff-8e20-f8ef58a039c4 tempest-AttachVolumeTestJSON-1680535427 None] Lock "cinder-73e7077c-ce3f-4ae9-8119-760fda835538-delete_volume" released by "delete_volume" :: held 1.475s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:46:09 devstack sudo[94323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-648cc8e9-bb21-4419-a317-65e05a03af4a Aug 09 12:46:09 devstack sudo[94323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:09 devstack sudo[94323]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-648cc8e9-bb21-4419-a317-65e05a03af4a" returned: 0 in 0.415s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-648cc8e9-bb21-4419-a317-65e05a03af4a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:09 devstack sudo[94330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-648cc8e9-bb21-4419-a317-65e05a03af4a Aug 09 12:46:09 devstack sudo[94330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:09 devstack sudo[94330]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-648cc8e9-bb21-4419-a317-65e05a03af4a" returned: 0 in 0.283s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Lock "cinder-quobyte-648cc8e9-bb21-4419-a317-65e05a03af4a" released by "delete_volume" :: held 0.751s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Created reservations ['ec49e391-a3de-4f8d-9291-e00844a8c625', 'e8052792-4f3a-4302-90fa-181e5354ebd4', 'd146df95-0f3f-4fb6-8760-73fe63c7cea5', '93d9ae0d-f4dd-45a3-b146-85df4e646ead'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:09 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:46:09 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:10 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.322s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:10 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Cloning volume 802d4d4b-82a9-4913-902b-25c5e5ef034b to volume 22760fe2-c391-49df-8486-6a178e9a69d0 Aug 09 12:46:10 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Deleted volume successfully. Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4d51f1a6-7dac-4684-ad0c-2f34fac649c8 tempest-AttachVolumeTestJSON-1680535427 None] Lock "cinder-648cc8e9-bb21-4419-a317-65e05a03af4a-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "cinder-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Creating offline snapshot 18a772d7-b727-46de-b299-47d737ceb636 of volume 802d4d4b-82a9-4913-902b-25c5e5ef034b {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Lock "cinder-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[917be94e-6e08-4ca3-abd5-1b9d7740e06a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "cinder-quobyte-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Lock "cinder-quobyte-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a" acquired by "delete_volume" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f3c4ec-1c85-4c2a-8a3c-d4a661924197]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:10 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b Aug 09 12:46:10 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:10 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a Aug 09 12:46:10 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:10 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b" returned: 0 in 0.476s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:10 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:10 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 1G Aug 09 12:46:10 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a" returned: 0 in 0.392s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:10 devstack sudo[94349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a Aug 09 12:46:10 devstack sudo[94349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:11 devstack sudo[94349]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a" returned: 0 in 0.259s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Lock "cinder-quobyte-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a" released by "delete_volume" :: held 0.703s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Created reservations ['3ab44ef4-1489-49a9-8d34-9d30a0043426', '2ec9bf6f-ad06-4e32-a61c-d4e5265e8d28', '4e7dad50-48b3-47b1-a0d5-9a9544cb3bda', '6619669b-6797-4a58-850f-584ae3c3ebac'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:11 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 1G" returned: 0 in 0.461s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802d4d4b-82a9-4913-902b-25c5e5ef034b -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:11 devstack sudo[94356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:46:11 devstack sudo[94356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:11 devstack sudo[94357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802d4d4b-82a9-4913-902b-25c5e5ef034b -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 Aug 09 12:46:11 devstack sudo[94357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:11 devstack sudo[94356]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:11 devstack sudo[94357]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.329s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-802d4d4b-82a9-4913-902b-25c5e5ef034b -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636" returned: 0 in 0.323s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:11 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Deleted volume successfully. Aug 09 12:46:11 devstack sudo[94364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 Aug 09 12:46:11 devstack sudo[94364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ce2d4a58-f24e-4ea0-8f11-fadc2a22d4f1 tempest-AttachVolumeTestJSON-1680535427 None] Lock "cinder-eeea5cc8-6c65-49ed-87d3-4d5a8b84425a-delete_volume" released by "delete_volume" :: held 1.332s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:46:11 devstack sudo[94364]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636" returned: 0 in 0.315s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:11 devstack sudo[94367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.info Aug 09 12:46:11 devstack sudo[94367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:12 devstack sudo[94367]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.info" returned: 0 in 0.275s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:12 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.info is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:46:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:12 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.info Aug 09 12:46:12 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:12 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.info" returned: 0 in 0.312s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Acquiring lock "cinder-quobyte-22760fe2-c391-49df-8486-6a178e9a69d0" by "_copy_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:46:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Lock "cinder-quobyte-22760fe2-c391-49df-8486-6a178e9a69d0" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:46:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] snapshot: 18a772d7-b727-46de-b299-47d737ceb636, volume: 22760fe2-c391-49df-8486-6a178e9a69d0, {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 12:46:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:46:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:46:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:12 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9280bb50-3971-4368-9886-07f83d473b08]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:46:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:12 devstack sudo[94374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 Aug 09 12:46:12 devstack sudo[94374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:13 devstack sudo[94374]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636" returned: 0 in 0.462s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802d4d4b-82a9-4913-902b-25c5e5ef034b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:46:13 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[632d325a-1479-40e9-b09a-034b6ff8f096]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:46:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:13 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b Aug 09 12:46:13 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:13 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b" returned: 0 in 0.504s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 12:46:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Creating direct copy from snapshot {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 12:46:13 devstack cinder-volume[89309]: DEBUG cinder.utils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Path /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0 not found in is_blk_device check {{(pid=89309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 12:46:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:13 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0 Aug 09 12:46:13 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:20 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0" returned: 0 in 6.651s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:20 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b, size 1024.00 MB, duration 6.65 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:46:20 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Converted 1024.00 MB image at 153.91 MB/s Aug 09 12:46:20 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0 is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:46:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:20 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0 Aug 09 12:46:20 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:20 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0" returned: 0 in 0.315s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Lock "cinder-quobyte-22760fe2-c391-49df-8486-6a178e9a69d0" released by "_copy_volume_from_snapshot" :: held 8.026s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:46:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Acquiring lock "cinder-quobyte-18a772d7-b727-46de-b299-47d737ceb636" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:46:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Lock "cinder-quobyte-18a772d7-b727-46de-b299-47d737ceb636" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:46:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Deleting offline snapshot 18a772d7-b727-46de-b299-47d737ceb636 of volume 802d4d4b-82a9-4913-902b-25c5e5ef034b {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:46:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] snapshot_file for this snap is: volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:46:20 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e235137-a8d7-40e2-8a6b-d952d43cc4d2]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:46:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:20 devstack sudo[94425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 Aug 09 12:46:20 devstack sudo[94425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:21 devstack sudo[94425]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636" returned: 0 in 0.559s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-802d4d4b-82a9-4913-902b-25c5e5ef034b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:46:21 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bab839-c1b9-467b-ace4-302fa28437c3]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:46:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-b86b2ada-7c62-4663-a61e-d310608db8be req-a52c1b42-3d0b-4ac8-8ede-3ecb9be0f3c7 tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:21 devstack sudo[94439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b Aug 09 12:46:21 devstack sudo[94439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:21 devstack sudo[94439]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b" returned: 0 in 0.615s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:21 devstack sudo[94444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 Aug 09 12:46:21 devstack sudo[94444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:22 devstack sudo[94444]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636" returned: 0 in 0.429s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:22 devstack sudo[94450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636 Aug 09 12:46:22 devstack sudo[94450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:22 devstack sudo[94450]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b.18a772d7-b727-46de-b299-47d737ceb636" returned: 0 in 0.307s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Lock "cinder-quobyte-18a772d7-b727-46de-b299-47d737ceb636" released by "_delete_snapshot" :: held 2.056s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:46:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.506s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-b86b2ada-7c62-4663-a61e-d310608db8be req-a52c1b42-3d0b-4ac8-8ede-3ecb9be0f3c7 tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.311s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-b86b2ada-7c62-4663-a61e-d310608db8be req-a52c1b42-3d0b-4ac8-8ede-3ecb9be0f3c7 tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-b86b2ada-7c62-4663-a61e-d310608db8be req-a52c1b42-3d0b-4ac8-8ede-3ecb9be0f3c7 tempest-ServerActionsTestOtherA-978128034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-14b1ff99-f7a9-43e6-8204-306b423777a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88106f1e-8d9b-4769-87f6-9512ca44ec80', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:46:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-bcb48589-6c87-4323-8d5a-98767db2e7f0 tempest-GroupsV314Test-1972928626 None] Create group from source-group-aa62f202-6fc9-4cd5-bc09-4e4bc6603da2 completed successfully. Aug 09 12:46:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-b86b2ada-7c62-4663-a61e-d310608db8be req-a52c1b42-3d0b-4ac8-8ede-3ecb9be0f3c7 tempest-ServerActionsTestOtherA-978128034 None] attachment_update completed successfully. Aug 09 12:46:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Acquiring lock "cinder-quobyte-22760fe2-c391-49df-8486-6a178e9a69d0" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:46:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Lock "cinder-quobyte-22760fe2-c391-49df-8486-6a178e9a69d0" acquired by "delete_volume" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:46:24 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[51dde576-623a-4484-a680-8a504b9a2509]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:46:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:24 devstack sudo[94839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0 Aug 09 12:46:24 devstack sudo[94839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:25 devstack sudo[94839]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0" returned: 0 in 0.446s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:25 devstack sudo[94844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0 Aug 09 12:46:25 devstack sudo[94844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:25 devstack sudo[94844]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-22760fe2-c391-49df-8486-6a178e9a69d0" returned: 0 in 0.303s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Lock "cinder-quobyte-22760fe2-c391-49df-8486-6a178e9a69d0" released by "delete_volume" :: held 0.815s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:46:25 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Created reservations ['4e4f4270-141f-47ae-a9a5-28ccf49a49fa'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:46:25 devstack cinder-volume[89309]: WARNING cinder.quota [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1430278846 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1430278846, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:46:25 devstack cinder-volume[89309]: WARNING cinder.quota [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1430278846 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1430278846, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:46:25 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Created reservations ['ab625f38-067a-4284-b14b-7b532fb617ac', 'bec5309d-ddf3-4219-a29c-01eab13dda56', '8b1f4112-1ab6-4f03-a72b-0bbf3dca1d78', '4166a554-b266-491d-82c4-fe9b45d50cca'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:46:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:46:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:46:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:25 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:46:25 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:26 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.400s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:26 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:46:26 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8c055df5-792a-4fd0-8fe2-4562b4cf7d7a tempest-GroupsV314Test-1972928626 None] Delete group completed successfully. Aug 09 12:46:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Acquiring lock "cinder-quobyte-802d4d4b-82a9-4913-902b-25c5e5ef034b" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:46:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Lock "cinder-quobyte-802d4d4b-82a9-4913-902b-25c5e5ef034b" acquired by "delete_volume" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:46:26 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ff3035f-da79-4ae5-918e-bc2946cdbed0]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:46:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:26 devstack sudo[94853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b Aug 09 12:46:26 devstack sudo[94853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:26 devstack sudo[94853]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b" returned: 0 in 0.468s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:26 devstack sudo[94864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b Aug 09 12:46:26 devstack sudo[94864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:27 devstack sudo[94864]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-802d4d4b-82a9-4913-902b-25c5e5ef034b" returned: 0 in 0.353s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Lock "cinder-quobyte-802d4d4b-82a9-4913-902b-25c5e5ef034b" released by "delete_volume" :: held 0.958s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:46:27 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Created reservations ['2f143a61-283f-4e82-b71f-f53bf62a77b2'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:46:27 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-0f25086c-6075-4bb0-a840-d39e846614fd req-c12a80d2-e824-493e-9f5b-6d238bc58b1e tempest-ServerActionsTestOtherA-978128034 None] Terminate volume connection completed successfully. Aug 09 12:46:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-0f25086c-6075-4bb0-a840-d39e846614fd req-c12a80d2-e824-493e-9f5b-6d238bc58b1e tempest-ServerActionsTestOtherA-978128034 None] Deleting attachment 88106f1e-8d9b-4769-87f6-9512ca44ec80. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:46:27 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Created reservations ['098d108d-4d95-4b08-b403-9893976cfb5a', 'f19de9c5-a34c-457e-9b88-9fb767a59ed6', '0b35e52f-a29f-4153-8e61-e3658d39a24d', 'df58ab1d-8672-4a78-ab93-c910157b2324'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:46:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:46:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:46:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:27 devstack sudo[94897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:46:27 devstack sudo[94897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:28 devstack sudo[94897]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.456s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:28 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:46:28 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-71e3d3e0-29f9-4c53-a14d-7e4b86a2d96c tempest-GroupsV314Test-1972928626 None] Delete group completed successfully. Aug 09 12:46:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-0f25086c-6075-4bb0-a840-d39e846614fd req-85d6b9cb-1cf0-41ae-ba45-435620076f3b tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-0f25086c-6075-4bb0-a840-d39e846614fd req-85d6b9cb-1cf0-41ae-ba45-435620076f3b tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-0f25086c-6075-4bb0-a840-d39e846614fd req-85d6b9cb-1cf0-41ae-ba45-435620076f3b tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-0f25086c-6075-4bb0-a840-d39e846614fd req-85d6b9cb-1cf0-41ae-ba45-435620076f3b tempest-ServerActionsTestOtherA-978128034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-14b1ff99-f7a9-43e6-8204-306b423777a6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb25f372-602c-4a34-80dd-98d43e3236b4', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:46:28 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-0f25086c-6075-4bb0-a840-d39e846614fd req-85d6b9cb-1cf0-41ae-ba45-435620076f3b tempest-ServerActionsTestOtherA-978128034 None] attachment_update completed successfully. Aug 09 12:46:38 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=57,cinder:UPDATE=53,cinder:INSERT=14,cinder:DELETE=1 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:46:38 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=59,cinder:SELECT=53,cinder:INSERT=11,cinder:DELETE=3 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:46:42 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e25756fe-89fa-48b4-837c-0d2bfb715627 tempest-GroupsV320Test-215038127 None] Group tempest-GroupsV320Test-Group-756525503: creating Aug 09 12:46:42 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e25756fe-89fa-48b4-837c-0d2bfb715627 tempest-GroupsV320Test-215038127 None] Group tempest-GroupsV320Test-Group-756525503: created successfully Aug 09 12:46:42 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e25756fe-89fa-48b4-837c-0d2bfb715627 tempest-GroupsV320Test-215038127 None] Create group completed successfully. Aug 09 12:46:44 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-196fdd8d-8eb9-45b6-b00e-cb35eae99d8f tempest-GroupsV320Test-215038127 None] Created reservations ['5047cf8a-6ff2-4e4d-8ee5-5d20c8c7d0eb'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:46:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-196fdd8d-8eb9-45b6-b00e-cb35eae99d8f tempest-GroupsV320Test-215038127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-196fdd8d-8eb9-45b6-b00e-cb35eae99d8f tempest-GroupsV320Test-215038127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-196fdd8d-8eb9-45b6-b00e-cb35eae99d8f tempest-GroupsV320Test-215038127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:46:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-196fdd8d-8eb9-45b6-b00e-cb35eae99d8f tempest-GroupsV320Test-215038127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:46:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-196fdd8d-8eb9-45b6-b00e-cb35eae99d8f tempest-GroupsV320Test-215038127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-196fdd8d-8eb9-45b6-b00e-cb35eae99d8f tempest-GroupsV320Test-215038127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:44 devstack sudo[95441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:46:44 devstack sudo[95441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:44 devstack sudo[95441]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-196fdd8d-8eb9-45b6-b00e-cb35eae99d8f tempest-GroupsV320Test-215038127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.425s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:44 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-196fdd8d-8eb9-45b6-b00e-cb35eae99d8f tempest-GroupsV320Test-215038127 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:46:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-196fdd8d-8eb9-45b6-b00e-cb35eae99d8f tempest-GroupsV320Test-215038127 None] Delete group completed successfully. Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Flow 'volume_create_manager' (0d03fc30-0482-4047-855e-44275dc268ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf143a92-4729-4b3c-8f62-c00c00f143c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf143a92-4729-4b3c-8f62-c00c00f143c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2048041867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29cccc3c-1bdc-42fc-906a-fb022a17d87e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446343db14364f0ebf2895493f513d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:46:54Z,use_quota=True,user_id='fbfbced7b9624be5aa797ffb41beadcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb1d65e-b451-4a61-a4bd-eb0a0a0675ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb1d65e-b451-4a61-a4bd-eb0a0a0675ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd000cbf-995b-44ba-a334-1ea9d6268f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd000cbf-995b-44ba-a334-1ea9d6268f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29cccc3c-1bdc-42fc-906a-fb022a17d87e', 'volume_name': 'volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac7d43e-9bb8-45e1-91f0-a0a685da4f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac7d43e-9bb8-45e1-91f0-a0a685da4f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285fbb08-120a-4bff-aa89-05de28817ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:46:54 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Volume 29cccc3c-1bdc-42fc-906a-fb022a17d87e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e', 'volume_size': 1} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:46:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2048041867',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29cccc3c-1bdc-42fc-906a-fb022a17d87e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='446343db14364f0ebf2895493f513d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:46:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:46:54Z,use_quota=True,user_id='fbfbced7b9624be5aa797ffb41beadcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Creating volume 29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:46:54 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:46:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:54 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e 1073741824 Aug 09 12:46:54 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:55 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e 1073741824" returned: 0 in 0.877s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:55 devstack sudo[95608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e Aug 09 12:46:55 devstack sudo[95608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:55 devstack sudo[95608]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e" returned: 0 in 0.319s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:46:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.311s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (285fbb08-120a-4bff-aa89-05de28817ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:46:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ee2e09-4831-4cac-9d95-cc27c8e7c6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:46:55 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Volume volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e (29cccc3c-1bdc-42fc-906a-fb022a17d87e): created successfully Aug 09 12:46:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3ee2e09-4831-4cac-9d95-cc27c8e7c6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:46:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Flow 'volume_create_manager' (0d03fc30-0482-4047-855e-44275dc268ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:46:55 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-778f2522-5aec-432f-a80e-17d21a9fbddd tempest-SnapshotsActionsTest-2090878900 None] Created volume successfully. Aug 09 12:46:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] Creating offline snapshot 63fdbd29-9e8c-4b70-937b-120975cf2a11 of volume 29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:46:56 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c214525-fdef-414e-9fed-4c947f6654c4]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:46:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:57 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e Aug 09 12:46:57 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:57 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e" returned: 0 in 0.612s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:57 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 1G Aug 09 12:46:57 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:46:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:46:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:46:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:46:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:46:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:46:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:57 devstack sudo[95625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:46:57 devstack sudo[95625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:58 devstack sudo[95625]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.523s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:46:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:46:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 8 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:46:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:46:58 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 1G" returned: 0 in 0.805s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:58 devstack sudo[95632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 Aug 09 12:46:58 devstack sudo[95632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:58 devstack sudo[95632]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11" returned: 0 in 0.396s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:58 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 is being set with open permissions: ugo+rw Aug 09 12:46:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:58 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 Aug 09 12:46:58 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:59 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11" returned: 0 in 0.328s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:59 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.info Aug 09 12:46:59 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:59 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.info" returned: 0 in 0.396s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:59 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.info is being set with open permissions: ugo+rw Aug 09 12:46:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:46:59 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.info Aug 09 12:46:59 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:46:59 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Aug 09 12:46:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.info" returned: 0 in 0.459s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:46:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.155s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:00 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a70a3b83-3239-4f30-87e1-e736d87c2db5 tempest-SnapshotsActionsTest-2090878900 None] Create snapshot completed successfully Aug 09 12:47:01 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-39ef751c-7921-445a-8c04-bde37f39a1c6 req-214be12e-4947-4069-8fdb-fe5f85e83192 tempest-ServerActionsTestOtherA-978128034 None] Terminate volume connection completed successfully. Aug 09 12:47:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-39ef751c-7921-445a-8c04-bde37f39a1c6 req-214be12e-4947-4069-8fdb-fe5f85e83192 tempest-ServerActionsTestOtherA-978128034 None] Deleting attachment fb25f372-602c-4a34-80dd-98d43e3236b4. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:47:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] Creating offline snapshot 14a352aa-113d-482e-b984-5ea88618af92 of volume 29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:47:02 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9d45ec-4321-4d08-b1d9-164790128011]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:02 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 Aug 09 12:47:02 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:03 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11" returned: 0 in 1.011s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:47:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:03 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 1G Aug 09 12:47:03 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:04 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 1G" returned: 0 in 0.882s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:04 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 Aug 09 12:47:04 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:04 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92" returned: 0 in 0.844s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:04 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 is being set with open permissions: ugo+rw Aug 09 12:47:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:05 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 Aug 09 12:47:05 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:05 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92" returned: 0 in 0.468s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.525s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-570dc1bd-2a5f-4d30-b693-0482d7d54231 tempest-SnapshotsActionsTest-2090878900 None] Create snapshot completed successfully Aug 09 12:47:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Acquiring lock "cinder-14a352aa-113d-482e-b984-5ea88618af92-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-14a352aa-113d-482e-b984-5ea88618af92-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Acquiring lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Acquiring lock "cinder-quobyte-14a352aa-113d-482e-b984-5ea88618af92" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-14a352aa-113d-482e-b984-5ea88618af92" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Deleting offline snapshot 14a352aa-113d-482e-b984-5ea88618af92 of volume 29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:47:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] snapshot_file for this snap is: volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:47:06 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66cbe06-fced-4702-80a7-e28c4cd2c8b9]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:06 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 Aug 09 12:47:06 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:07 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92" returned: 0 in 0.524s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:47:07 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[860700d8-7908-4e97-ae7d-249ca3d53412]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:07 devstack sudo[95827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 Aug 09 12:47:07 devstack sudo[95827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:07 devstack sudo[95827]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11" returned: 0 in 0.721s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:47:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:08 devstack sudo[95832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 Aug 09 12:47:08 devstack sudo[95832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Flow 'volume_create_manager' (bd705ef8-3602-4d65-82d8-ec454396b519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60ab2c3-12e2-47f7-bccd-b90b558b7c8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e60ab2c3-12e2-47f7-bccd-b90b558b7c8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1096634275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f7f3a3-5131-44e9-b252-caacce01601a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9504a042ca54df3a488e4801d7a4715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:08Z,use_quota=True,user_id='b7ce60eb66354e22af0ecd6fed813168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f84d5a-8cea-4415-ae8f-45c7cfbe6b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9f84d5a-8cea-4415-ae8f-45c7cfbe6b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c210c6b-1370-4f48-b0fc-1e719d55649d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c210c6b-1370-4f48-b0fc-1e719d55649d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4f7f3a3-5131-44e9-b252-caacce01601a', 'volume_name': 'volume-e4f7f3a3-5131-44e9-b252-caacce01601a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b336b2ed-578e-4af8-98ee-f449bbae6fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b336b2ed-578e-4af8-98ee-f449bbae6fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7650c787-7221-44ac-ac36-9fab4b440a7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:08 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Volume e4f7f3a3-5131-44e9-b252-caacce01601a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4f7f3a3-5131-44e9-b252-caacce01601a', 'volume_size': 1} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1096634275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4f7f3a3-5131-44e9-b252-caacce01601a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9504a042ca54df3a488e4801d7a4715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:08Z,use_quota=True,user_id='b7ce60eb66354e22af0ecd6fed813168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Creating volume e4f7f3a3-5131-44e9-b252-caacce01601a {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:47:08 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e4f7f3a3-5131-44e9-b252-caacce01601a 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:08 devstack sudo[95837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e4f7f3a3-5131-44e9-b252-caacce01601a 1073741824 Aug 09 12:47:08 devstack sudo[95837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:08 devstack sudo[95832]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92" returned: 0 in 0.547s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:08 devstack sudo[95840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92 Aug 09 12:47:08 devstack sudo[95840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:08 devstack sudo[95840]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.14a352aa-113d-482e-b984-5ea88618af92" returned: 0 in 0.313s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-14a352aa-113d-482e-b984-5ea88618af92" released by "_delete_snapshot" :: held 2.247s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:08 devstack sudo[95837]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e4f7f3a3-5131-44e9-b252-caacce01601a 1073741824" returned: 0 in 0.572s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" released by "delete_snapshot" :: held 2.282s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e4f7f3a3-5131-44e9-b252-caacce01601a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:08 devstack cinder-volume[89309]: WARNING cinder.quota [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:47:08 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e4f7f3a3-5131-44e9-b252-caacce01601a Aug 09 12:47:08 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:08 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Created reservations ['4adc3b2a-5e41-48cc-83c0-64017b7b91ca', 'b4da4a8d-2475-421f-bb42-cacc03ec22b2', '59246d35-8a54-46ad-8cf9-c78fe8fa756c', '3e2a94fd-6b31-4428-97a0-c0aaed315dc9'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:47:09 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Delete snapshot completed successfully. Aug 09 12:47:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aae6a229-ae7a-4945-93c2-0ca3ca12b917 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-14a352aa-113d-482e-b984-5ea88618af92-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:09 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e4f7f3a3-5131-44e9-b252-caacce01601a" returned: 0 in 0.336s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:47:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7650c787-7221-44ac-ac36-9fab4b440a7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4f7f3a3-5131-44e9-b252-caacce01601a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11db669-e7e2-4c1f-b2fa-a66a4f590cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:09 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Volume volume-e4f7f3a3-5131-44e9-b252-caacce01601a (e4f7f3a3-5131-44e9-b252-caacce01601a): created successfully Aug 09 12:47:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a11db669-e7e2-4c1f-b2fa-a66a4f590cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Flow 'volume_create_manager' (bd705ef8-3602-4d65-82d8-ec454396b519) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:09 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-10294ce0-ea98-49d3-a362-28e04685729f tempest-VolumesActionsTest-1646050885 None] Created volume successfully. Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Flow 'volume_create_manager' (d86d74d9-afb6-4ec9-ab95-c0c700835da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc59d5a3-4de3-4ac3-b201-f22c9172d66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc59d5a3-4de3-4ac3-b201-f22c9172d66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-71128198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e66cb0-4e05-4a59-a96d-6b113120da5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd8264699f64ce9b650776ae66448e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:10Z,use_quota=True,user_id='e039d7ef77c34c84bc4b789c8242d787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4930e3cd-d547-4027-8d09-4e585d7e949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4930e3cd-d547-4027-8d09-4e585d7e949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d5ab3e-121d-4598-843b-0be94fcddec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.image.glance [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Creating Keystone auth plugin from conf {{(pid=89309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-44c3a354-e647-4865-b33a-6b62bec38c56 tempest-VolumesActionsTest-1646050885 None] Acquiring lock "cinder-e4f7f3a3-5131-44e9-b252-caacce01601a" by "attach_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-44c3a354-e647-4865-b33a-6b62bec38c56 tempest-VolumesActionsTest-1646050885 None] Lock "cinder-e4f7f3a3-5131-44e9-b252-caacce01601a" acquired by "attach_volume" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] Creating offline snapshot 0e54ea19-ecd0-4e11-bcac-56adbf293dd3 of volume 29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa85f8bb-a2ca-4f29-b2d3-c754586455dd]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:10 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-44c3a354-e647-4865-b33a-6b62bec38c56 tempest-VolumesActionsTest-1646050885 None] Attaching volume e4f7f3a3-5131-44e9-b252-caacce01601a to instance 717d4a50-8455-4a76-8f53-379af01ed736 at mountpoint /dev/vdb on host None. Aug 09 12:47:10 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-44c3a354-e647-4865-b33a-6b62bec38c56 tempest-VolumesActionsTest-1646050885 None] Attach volume completed successfully. Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-44c3a354-e647-4865-b33a-6b62bec38c56 tempest-VolumesActionsTest-1646050885 None] Lock "cinder-e4f7f3a3-5131-44e9-b252-caacce01601a" released by "attach_volume" :: held 0.175s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:10 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 Aug 09 12:47:10 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86d5ab3e-121d-4598-843b-0be94fcddec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f8e66cb0-4e05-4a59-a96d-6b113120da5a', 'volume_name': 'volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d37909d-ef89-4813-bdd9-a871cf2fd150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d37909d-ef89-4813-bdd9-a871cf2fd150) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e9fcd0-94de-4cd1-856f-a546c5061edc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:10 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Volume f8e66cb0-4e05-4a59-a96d-6b113120da5a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Trying to clone f8e66cb0-4e05-4a59-a96d-6b113120da5a from image edd103c7-208a-494c-8e8e-975b743b3cc4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]). {{(pid=89309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 12:47:10 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11" returned: 0 in 0.476s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:47:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:10 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 1G Aug 09 12:47:10 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-476ec396-ec35-4646-be1e-439765755994 tempest-VolumesActionsTest-463554358 None] Terminate volume connection completed successfully. Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-476ec396-ec35-4646-be1e-439765755994 tempest-VolumesActionsTest-463554358 None] Acquiring lock "cinder-e4f7f3a3-5131-44e9-b252-caacce01601a-detach_volume" by "detach_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 12:47:11 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Image download 20.69 MB at 20.69 MB/s Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-476ec396-ec35-4646-be1e-439765755994 tempest-VolumesActionsTest-463554358 None] Lock "cinder-e4f7f3a3-5131-44e9-b252-caacce01601a-detach_volume" acquired by "detach_volume" :: waited 0.045s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-476ec396-ec35-4646-be1e-439765755994 tempest-VolumesActionsTest-463554358 None] Detaching volume e4f7f3a3-5131-44e9-b252-caacce01601a from instance 717d4a50-8455-4a76-8f53-379af01ed736. Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b36733-0bb9-4505-85a2-8e02ef11056a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-476ec396-ec35-4646-be1e-439765755994 tempest-VolumesActionsTest-463554358 None] Detach volume completed successfully. Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-476ec396-ec35-4646-be1e-439765755994 tempest-VolumesActionsTest-463554358 None] Lock "cinder-e4f7f3a3-5131-44e9-b252-caacce01601a-detach_volume" released by "detach_volume" :: held 0.108s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:11 devstack sudo[95883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD Aug 09 12:47:11 devstack sudo[95883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:11 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 1G" returned: 0 in 0.619s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:11 devstack sudo[95885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 Aug 09 12:47:11 devstack sudo[95885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-66fab433-95c7-480f-ad9e-024fc685e804 tempest-VolumesActionsTest-1646050885 None] Acquiring lock "cinder-e4f7f3a3-5131-44e9-b252-caacce01601a-detach_volume" by "detach_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-66fab433-95c7-480f-ad9e-024fc685e804 tempest-VolumesActionsTest-1646050885 None] Lock "cinder-e4f7f3a3-5131-44e9-b252-caacce01601a-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-66fab433-95c7-480f-ad9e-024fc685e804 tempest-VolumesActionsTest-1646050885 None] Volume detach called, but volume not attached. Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-66fab433-95c7-480f-ad9e-024fc685e804 tempest-VolumesActionsTest-1646050885 None] Lock "cinder-e4f7f3a3-5131-44e9-b252-caacce01601a-detach_volume" released by "detach_volume" :: held 0.025s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:11 devstack sudo[95883]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD" returned: 0 in 0.400s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Temporary image edd103c7-208a-494c-8e8e-975b743b3cc4 is fetched for user e039d7ef77c34c84bc4b789c8242d787. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[72c85ed3-46cc-48de-b72b-90bc9527b628]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Acquiring lock "cinder-e4f7f3a3-5131-44e9-b252-caacce01601a-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Lock "cinder-e4f7f3a3-5131-44e9-b252-caacce01601a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:11 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD Aug 09 12:47:11 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:11 devstack sudo[95885]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Acquiring lock "cinder-quobyte-e4f7f3a3-5131-44e9-b252-caacce01601a" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3" returned: 0 in 0.579s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:12 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 is being set with open permissions: ugo+rw Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Lock "cinder-quobyte-e4f7f3a3-5131-44e9-b252-caacce01601a" acquired by "delete_volume" :: waited 0.052s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:12 devstack sudo[95895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 Aug 09 12:47:12 devstack sudo[95895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f48aee3-720d-416d-aaaa-4c748301f61a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e4f7f3a3-5131-44e9-b252-caacce01601a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:12 devstack sudo[95898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e4f7f3a3-5131-44e9-b252-caacce01601a Aug 09 12:47:12 devstack sudo[95898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:12 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD" returned: 0 in 0.594s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:12 devstack sudo[95895]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3" returned: 0 in 0.430s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.248s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.141s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-71128198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8e66cb0-4e05-4a59-a96d-6b113120da5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bd8264699f64ce9b650776ae66448e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:10Z,use_quota=True,user_id='e039d7ef77c34c84bc4b789c8242d787',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Creating volume f8e66cb0-4e05-4a59-a96d-6b113120da5a {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:47:12 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:12 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a 1073741824 Aug 09 12:47:12 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:12 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-95947130-ec38-440d-b4f5-a5cd15543ce3 tempest-SnapshotsActionsTest-2090878900 None] Create snapshot completed successfully Aug 09 12:47:12 devstack sudo[95898]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e4f7f3a3-5131-44e9-b252-caacce01601a" returned: 0 in 0.557s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e4f7f3a3-5131-44e9-b252-caacce01601a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:12 devstack sudo[95909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e4f7f3a3-5131-44e9-b252-caacce01601a Aug 09 12:47:12 devstack sudo[95909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:13 devstack sudo[95909]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e4f7f3a3-5131-44e9-b252-caacce01601a" returned: 0 in 0.393s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Lock "cinder-quobyte-e4f7f3a3-5131-44e9-b252-caacce01601a" released by "delete_volume" :: held 1.020s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:13 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a 1073741824" returned: 0 in 0.576s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Created reservations ['de7d2c80-ba61-49e3-a840-9b0ebe3cfe3f', '31c13645-e9ae-49c0-8b8d-871e671bcb05', '19f8267c-12d0-455a-b88a-c7dc9f884887', 'ab6d3e21-f195-459b-bb61-f3256b6e9cd6'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:47:13 devstack sudo[95916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a Aug 09 12:47:13 devstack sudo[95916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:13 devstack sudo[95918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:47:13 devstack sudo[95918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:13 devstack sudo[95916]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a" returned: 0 in 0.412s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Attempting download of edd103c7-208a-494c-8e8e-975b743b3cc4 ((None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}])) to volume f8e66cb0-4e05-4a59-a96d-6b113120da5a. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Acquiring lock "cinder-0e54ea19-ecd0-4e11-bcac-56adbf293dd3-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-0e54ea19-ecd0-4e11-bcac-56adbf293dd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.043s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Acquiring lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Acquiring lock "cinder-quobyte-0e54ea19-ecd0-4e11-bcac-56adbf293dd3" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d6d1a6-d05b-4d0f-85ef-0b149badde3d]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4n1n2ryr {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-0e54ea19-ecd0-4e11-bcac-56adbf293dd3" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Deleting offline snapshot 0e54ea19-ecd0-4e11-bcac-56adbf293dd3 of volume 29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] snapshot_file for this snap is: volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26aab64-665b-451d-a4a8-4fa6edaafd00]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:13 devstack sudo[95918]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.506s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:47:13 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Deleted volume successfully. Aug 09 12:47:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b370500a-f7c5-4cc9-94de-d6a6800b024b tempest-VolumesActionsTest-1646050885 None] Lock "cinder-e4f7f3a3-5131-44e9-b252-caacce01601a-delete_volume" released by "delete_volume" :: held 1.976s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:13 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4n1n2ryr Aug 09 12:47:13 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:13 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 Aug 09 12:47:13 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:14 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4n1n2ryr" returned: 0 in 0.419s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4n1n2ryr {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:14 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3" returned: 0 in 0.483s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:47:14 devstack sudo[95928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4n1n2ryr Aug 09 12:47:14 devstack sudo[95928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:14 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ab359a-0e99-4db3-aa9e-83b1bb3cea55]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:14 devstack sudo[95934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 Aug 09 12:47:14 devstack sudo[95934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:14 devstack sudo[95928]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4n1n2ryr" returned: 1 in 0.671s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4n1n2ryr' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:47:14 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e44bfb66-8a2c-4168-a8d2-15bf85bbd9af]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:14 devstack sudo[95934]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11" returned: 0 in 0.534s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:47:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:14 devstack sudo[95944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD Aug 09 12:47:14 devstack sudo[95944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:14 devstack sudo[95948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 Aug 09 12:47:14 devstack sudo[95948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:15 devstack sudo[95944]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD" returned: 0 in 0.452s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:15 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] edd103c7-208a-494c-8e8e-975b743b3cc4 was qcow2, converting to qcow2 {{(pid=89309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 12:47:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:15 devstack sudo[95975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a Aug 09 12:47:15 devstack sudo[95975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:15 devstack sudo[95948]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3" returned: 0 in 0.612s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:15 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3 Aug 09 12:47:15 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:15 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.0e54ea19-ecd0-4e11-bcac-56adbf293dd3" returned: 0 in 0.318s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-0e54ea19-ecd0-4e11-bcac-56adbf293dd3" released by "_delete_snapshot" :: held 2.123s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" released by "delete_snapshot" :: held 2.187s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:15 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Created reservations ['2696b751-b3c5-41b9-a07b-05a413711ca4', 'a65bb042-bfa9-4649-a825-638f29ca080c', '11c376d6-0e95-4e17-a444-0f46367e38d9', '1fe9f01f-5e98-44d9-941a-a44abc73b651'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:47:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Delete snapshot completed successfully. Aug 09 12:47:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b6900eb4-4aa8-40de-9306-8583eeb41077 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-0e54ea19-ecd0-4e11-bcac-56adbf293dd3-delete_snapshot" released by "delete_snapshot" :: held 2.374s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] Creating offline snapshot 9f9ff6ff-45ce-4cd6-9807-cad429187407 of volume 29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[882de1f3-f741-42c2-b58d-092adf9c86af]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:17 devstack sudo[95975]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a" returned: 0 in 2.290s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ddd6zhledevstack@QuobyteHD, size 112.00 MB, duration 2.29 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:47:17 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Converted 112.00 MB image at 48.87 MB/s Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:17 devstack sudo[95994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a 1G Aug 09 12:47:17 devstack sudo[95994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:17 devstack sudo[95993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 Aug 09 12:47:17 devstack sudo[95993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Flow 'volume_create_manager' (c0ce8c8a-4569-4cc0-b31c-514bf8ab2a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d3f1cb-df64-4ee7-a609-df4d5ca3ec42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:17 devstack sudo[95994]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a 1G" returned: 0 in 0.400s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Downloaded image edd103c7-208a-494c-8e8e-975b743b3cc4 ((None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}])) to volume f8e66cb0-4e05-4a59-a96d-6b113120da5a successfully. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Temporary image edd103c7-208a-494c-8e8e-975b743b3cc4 for user e039d7ef77c34c84bc4b789c8242d787 is deleted. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 12:47:17 devstack sudo[95993]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Marking volume f8e66cb0-4e05-4a59-a96d-6b113120da5a as bootable. {{(pid=89309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11" returned: 0 in 0.514s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:47:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91d3f1cb-df64-4ee7-a609-df4d5ca3ec42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-781366950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91cff1c3-d9ac-4f38-9c12-77aa331f170b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449b0c9106848fb82e1dbd136bfc0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:18Z,use_quota=True,user_id='e8b50efbedcb4af9bd4b07565bd6e969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:18 devstack sudo[96003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 1G Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2f833d-538e-420e-a883-ece2fe8f9003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:18 devstack sudo[96003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb2f833d-538e-420e-a883-ece2fe8f9003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51e7056-27af-42d5-ae56-aa92d8ad7343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e51e7056-27af-42d5-ae56-aa92d8ad7343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91cff1c3-d9ac-4f38-9c12-77aa331f170b', 'volume_name': 'volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12357367-3d9c-456d-ad8f-531fc9e36011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12357367-3d9c-456d-ad8f-531fc9e36011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a8dd27-b323-4e65-8381-757ef869ca47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:18 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Volume 91cff1c3-d9ac-4f38-9c12-77aa331f170b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b', 'volume_size': 1} Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Copying metadata from image edd103c7-208a-494c-8e8e-975b743b3cc4 to f8e66cb0-4e05-4a59-a96d-6b113120da5a. {{(pid=89309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Creating volume glance metadata for volume f8e66cb0-4e05-4a59-a96d-6b113120da5a backed by image edd103c7-208a-494c-8e8e-975b743b3cc4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2e9fcd0-94de-4cd1-856f-a546c5061edc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44dda3b-24ae-44e6-ae6c-78b9d2c84401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:18 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Volume volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a (f8e66cb0-4e05-4a59-a96d-6b113120da5a): created successfully Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a44dda3b-24ae-44e6-ae6c-78b9d2c84401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Flow 'volume_create_manager' (d86d74d9-afb6-4ec9-ab95-c0c700835da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:18 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-994b14be-f460-43f1-9c7f-bbed88064d52 tempest-ServerActionsTestOtherA-978128034 None] Created volume successfully. Aug 09 12:47:18 devstack sudo[96003]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 1G" returned: 0 in 0.421s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:18 devstack sudo[96009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 Aug 09 12:47:18 devstack sudo[96009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:18 devstack sudo[96009]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407" returned: 0 in 0.290s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:18 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 is being set with open permissions: ugo+rw Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:18 devstack sudo[96014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 Aug 09 12:47:18 devstack sudo[96014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:18 devstack sudo[96014]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407" returned: 0 in 0.297s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.694s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.999s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-781366950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91cff1c3-d9ac-4f38-9c12-77aa331f170b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449b0c9106848fb82e1dbd136bfc0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:18Z,use_quota=True,user_id='e8b50efbedcb4af9bd4b07565bd6e969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Creating volume 91cff1c3-d9ac-4f38-9c12-77aa331f170b {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:47:19 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:19 devstack sudo[96017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b 1073741824 Aug 09 12:47:19 devstack sudo[96017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:19 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-884ff5a5-d8c3-4bc8-8013-9ad69e232d96 tempest-SnapshotsActionsTest-2090878900 None] Create snapshot completed successfully Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Flow 'volume_create_manager' (412a2935-56c0-4b91-b992-be3d3de0cde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f241904-ccb2-4227-8791-81762be0959c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f241904-ccb2-4227-8791-81762be0959c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-786999175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132a31a2-9618-4ff4-9904-58a25f6a9c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9504a042ca54df3a488e4801d7a4715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:19Z,use_quota=True,user_id='b7ce60eb66354e22af0ecd6fed813168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1349f2-2769-4a69-bbd0-e62e8b0f8e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b1349f2-2769-4a69-bbd0-e62e8b0f8e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d82dbcc-e4cc-4499-a475-32ea274efb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d82dbcc-e4cc-4499-a475-32ea274efb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '132a31a2-9618-4ff4-9904-58a25f6a9c2f', 'volume_name': 'volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75f3aab-54d5-4257-aa22-12c5f44b2005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f75f3aab-54d5-4257-aa22-12c5f44b2005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2570020b-f8ea-4a7f-962e-2a6ab1442886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:19 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Volume 132a31a2-9618-4ff4-9904-58a25f6a9c2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f', 'volume_size': 1} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Acquiring lock "cinder-9f9ff6ff-45ce-4cd6-9807-cad429187407-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-9f9ff6ff-45ce-4cd6-9807-cad429187407-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Acquiring lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Acquiring lock "cinder-quobyte-9f9ff6ff-45ce-4cd6-9807-cad429187407" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-9f9ff6ff-45ce-4cd6-9807-cad429187407" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:19 devstack sudo[96017]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Deleting offline snapshot 9f9ff6ff-45ce-4cd6-9807-cad429187407 of volume 29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] snapshot_file for this snap is: volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b 1073741824" returned: 0 in 0.571s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b39f7b-02f1-4bc1-95d7-2c84ab3745b5]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:19 devstack sudo[96025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b Aug 09 12:47:19 devstack sudo[96025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:19 devstack sudo[96024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 Aug 09 12:47:19 devstack sudo[96024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:19 devstack sudo[96025]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b" returned: 0 in 0.275s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.691s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-786999175',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=132a31a2-9618-4ff4-9904-58a25f6a9c2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9504a042ca54df3a488e4801d7a4715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:19Z,use_quota=True,user_id='b7ce60eb66354e22af0ecd6fed813168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Creating volume 132a31a2-9618-4ff4-9904-58a25f6a9c2f {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:47:19 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:47:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32a8dd27-b323-4e65-8381-757ef869ca47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:20 devstack sudo[96034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f 1073741824 Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4cb3ba-91b4-4795-882b-f48da2193430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:20 devstack sudo[96034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:20 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Volume volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b (91cff1c3-d9ac-4f38-9c12-77aa331f170b): created successfully Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a4cb3ba-91b4-4795-882b-f48da2193430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Flow 'volume_create_manager' (c0ce8c8a-4569-4cc0-b31c-514bf8ab2a0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:20 devstack sudo[96024]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:20 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-87f44a4c-fabe-44a6-bb5f-8c8d5cacec6e tempest-AttachVolumeNegativeTest-1965921425 None] Created volume successfully. Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407" returned: 0 in 0.456s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3578adc-52ba-449f-b34b-dfb579c7a35c]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:20 devstack sudo[96037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 Aug 09 12:47:20 devstack sudo[96037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:20 devstack sudo[96034]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f 1073741824" returned: 0 in 0.549s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:20 devstack sudo[96037]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11" returned: 0 in 0.421s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:20 devstack sudo[96046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 Aug 09 12:47:20 devstack sudo[96046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:20 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f Aug 09 12:47:20 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:20 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f" returned: 0 in 0.279s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2570020b-f8ea-4a7f-962e-2a6ab1442886) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdcb096-1f6d-43b8-bfd6-c93302779415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:20 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Volume volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f (132a31a2-9618-4ff4-9904-58a25f6a9c2f): created successfully Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bdcb096-1f6d-43b8-bfd6-c93302779415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Flow 'volume_create_manager' (412a2935-56c0-4b91-b992-be3d3de0cde2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:20 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4eb9ed25-aa49-480d-b871-503a42d112a3 tempest-VolumesActionsTest-1646050885 None] Created volume successfully. Aug 09 12:47:20 devstack sudo[96046]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407" returned: 0 in 0.439s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:21 devstack sudo[96056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407 Aug 09 12:47:21 devstack sudo[96056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:21 devstack sudo[96056]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.9f9ff6ff-45ce-4cd6-9807-cad429187407" returned: 0 in 0.297s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-9f9ff6ff-45ce-4cd6-9807-cad429187407" released by "_delete_snapshot" :: held 1.728s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" released by "delete_snapshot" :: held 1.753s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:21 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Created reservations ['6ebc074c-4482-474c-8d2e-ca9acdfa46f9', '7fa9cfa4-27dc-4de3-a960-fb23d1bbc395', 'd7dc2221-cb3e-4382-badf-b4e0f0949fbc', '9a57fa0c-ccde-4e69-9328-2bc6355796bb'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:47:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Acquiring lock "cinder-132a31a2-9618-4ff4-9904-58a25f6a9c2f-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:21 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Delete snapshot completed successfully. Aug 09 12:47:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Lock "cinder-132a31a2-9618-4ff4-9904-58a25f6a9c2f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-58a58eea-b4e3-4035-9f83-abbb08a40008 tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-9f9ff6ff-45ce-4cd6-9807-cad429187407-delete_snapshot" released by "delete_snapshot" :: held 1.956s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Acquiring lock "cinder-quobyte-132a31a2-9618-4ff4-9904-58a25f6a9c2f" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Lock "cinder-quobyte-132a31a2-9618-4ff4-9904-58a25f6a9c2f" acquired by "delete_volume" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:21 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a127d9-2115-4687-a899-6d55087dbc29]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:21 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f Aug 09 12:47:21 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:22 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f" returned: 0 in 0.534s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-9a8d637a-7331-4438-899e-44316db5c1ac req-2cae5b66-a377-45d0-bf1a-ca9e214a54f4 tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-9a8d637a-7331-4438-899e-44316db5c1ac req-2cae5b66-a377-45d0-bf1a-ca9e214a54f4 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:22 devstack sudo[96086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f Aug 09 12:47:22 devstack sudo[96086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-9a8d637a-7331-4438-899e-44316db5c1ac req-2cae5b66-a377-45d0-bf1a-ca9e214a54f4 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] Creating offline snapshot c6474917-e4f0-4c54-942f-ece563dd3835 of volume 29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-9a8d637a-7331-4438-899e-44316db5c1ac req-2cae5b66-a377-45d0-bf1a-ca9e214a54f4 tempest-AttachVolumeNegativeTest-1965921425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '75e4865f-bd72-491a-bf95-b88fc1c2d10f', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f711bd08-b34c-4c21-bdb0-9a1b8a3f1738]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-b97a93d5-26c2-4b8e-8acd-5451f494ea3a req-bd285ebb-a453-4aef-8fac-98d994b3f9f6 tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-9a8d637a-7331-4438-899e-44316db5c1ac req-2cae5b66-a377-45d0-bf1a-ca9e214a54f4 tempest-AttachVolumeNegativeTest-1965921425 None] attachment_update completed successfully. Aug 09 12:47:22 devstack sudo[96086]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-132a31a2-9618-4ff4-9904-58a25f6a9c2f" returned: 0 in 0.341s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Lock "cinder-quobyte-132a31a2-9618-4ff4-9904-58a25f6a9c2f" released by "delete_volume" :: held 0.945s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:22 devstack sudo[96088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 Aug 09 12:47:22 devstack sudo[96088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Created reservations ['1f9b3ce9-38a6-4a06-9bd0-4ed53439ab77', 'e4f09703-cdf3-4d59-9618-ffb465b13b46', '3bd76c00-d748-43ce-a09e-a73328a238b8', '91d44609-b1e5-4bda-8933-bac1983b6bfb'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:22 devstack sudo[96137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:47:22 devstack sudo[96137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:23 devstack sudo[96088]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11" returned: 0 in 0.622s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:23 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 1G Aug 09 12:47:23 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:23 devstack sudo[96137]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.492s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:47:23 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Deleted volume successfully. Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-af51d16f-cf9d-4bdd-b736-1f587936f16e tempest-VolumesActionsTest-463554358 None] Lock "cinder-132a31a2-9618-4ff4-9904-58a25f6a9c2f-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Flow 'volume_create_manager' (8ed8b97b-cbce-4401-a5c0-35bf71d9ce7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6271e2-9cf5-497b-92c1-22359b29deb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c6271e2-9cf5-497b-92c1-22359b29deb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1458532019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de5750a-edc5-4458-9097-7fe2b8c6bf18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9504a042ca54df3a488e4801d7a4715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:24Z,use_quota=True,user_id='b7ce60eb66354e22af0ecd6fed813168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9665c7c0-3fa7-4642-b957-0969fdeed3f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:23 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9665c7c0-3fa7-4642-b957-0969fdeed3f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f7a82d-6956-497d-8c75-51f13e05caaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f7a82d-6956-497d-8c75-51f13e05caaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6de5750a-edc5-4458-9097-7fe2b8c6bf18', 'volume_name': 'volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a9e19e-04bf-4c6c-a001-a1499c324bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28a9e19e-04bf-4c6c-a001-a1499c324bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2ab838-4d50-4460-b7d8-916597bb9e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:23 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Volume 6de5750a-edc5-4458-9097-7fe2b8c6bf18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18', 'volume_size': 1} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 1G" returned: 0 in 0.796s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:23 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 Aug 09 12:47:23 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:24 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835" returned: 0 in 0.317s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:24 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 is being set with open permissions: ugo+rw Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:24 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 Aug 09 12:47:24 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:24 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835" returned: 0 in 0.263s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.162s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-b97a93d5-26c2-4b8e-8acd-5451f494ea3a req-bd285ebb-a453-4aef-8fac-98d994b3f9f6 tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.033s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-b97a93d5-26c2-4b8e-8acd-5451f494ea3a req-bd285ebb-a453-4aef-8fac-98d994b3f9f6 tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.655s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1458532019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6de5750a-edc5-4458-9097-7fe2b8c6bf18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9504a042ca54df3a488e4801d7a4715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:24Z,use_quota=True,user_id='b7ce60eb66354e22af0ecd6fed813168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Creating volume 6de5750a-edc5-4458-9097-7fe2b8c6bf18 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:47:24 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:24 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2c89e36a-3829-416c-a0e4-d00303fbe143 tempest-SnapshotsActionsTest-2090878900 None] Create snapshot completed successfully Aug 09 12:47:24 devstack sudo[96498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18 1073741824 Aug 09 12:47:24 devstack sudo[96498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-b97a93d5-26c2-4b8e-8acd-5451f494ea3a req-bd285ebb-a453-4aef-8fac-98d994b3f9f6 tempest-ServerActionsTestOtherA-978128034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '100cff21-2fdf-4d73-86f6-58e1197af7f8', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:47:24 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-b97a93d5-26c2-4b8e-8acd-5451f494ea3a req-bd285ebb-a453-4aef-8fac-98d994b3f9f6 tempest-ServerActionsTestOtherA-978128034 None] attachment_update completed successfully. Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Acquiring lock "cinder-c6474917-e4f0-4c54-942f-ece563dd3835-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-c6474917-e4f0-4c54-942f-ece563dd3835-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Acquiring lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Acquiring lock "cinder-quobyte-c6474917-e4f0-4c54-942f-ece563dd3835" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-c6474917-e4f0-4c54-942f-ece563dd3835" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Deleting offline snapshot c6474917-e4f0-4c54-942f-ece563dd3835 of volume 29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] snapshot_file for this snap is: volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:47:25 devstack sudo[96498]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cacb9bd-881d-4be1-9d20-2f5046e4b83e]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18 1073741824" returned: 0 in 0.750s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:25 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18 Aug 09 12:47:25 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:25 devstack sudo[96504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 Aug 09 12:47:25 devstack sudo[96504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:25 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18" returned: 0 in 0.574s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c2ab838-4d50-4460-b7d8-916597bb9e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c33bb0-ade8-4854-96b3-5ce81a54d7ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:25 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Volume volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18 (6de5750a-edc5-4458-9097-7fe2b8c6bf18): created successfully Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07c33bb0-ade8-4854-96b3-5ce81a54d7ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Flow 'volume_create_manager' (8ed8b97b-cbce-4401-a5c0-35bf71d9ce7c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:26 devstack sudo[96504]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835" returned: 0 in 0.754s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:47:26 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c0bdaf84-c5f5-4b33-bf5a-06774acc480c tempest-VolumesActionsTest-1646050885 None] Created volume successfully. Aug 09 12:47:26 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1f7d15-75be-4b1b-a9a2-379e49b63e97]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:26 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 Aug 09 12:47:26 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:26 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11" returned: 0 in 0.499s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:47:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:26 devstack sudo[96552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 Aug 09 12:47:26 devstack sudo[96552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:27 devstack sudo[96552]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835" returned: 0 in 0.524s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:27 devstack sudo[96570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835 Aug 09 12:47:27 devstack sudo[96570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Acquiring lock "cinder-6de5750a-edc5-4458-9097-7fe2b8c6bf18-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Lock "cinder-6de5750a-edc5-4458-9097-7fe2b8c6bf18-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Acquiring lock "cinder-quobyte-6de5750a-edc5-4458-9097-7fe2b8c6bf18" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Lock "cinder-quobyte-6de5750a-edc5-4458-9097-7fe2b8c6bf18" acquired by "delete_volume" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0b3715-639d-4450-8a82-3279eca69df9]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:27 devstack sudo[96570]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.c6474917-e4f0-4c54-942f-ece563dd3835" returned: 0 in 0.397s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-c6474917-e4f0-4c54-942f-ece563dd3835" released by "_delete_snapshot" :: held 2.340s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:27 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18 Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" released by "delete_snapshot" :: held 2.373s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:27 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Created reservations ['06958136-82a4-4ed0-bd5f-1c7379ef29b8', '90a1770b-a95d-43a4-8d18-cb7639f1a5e3', 'e788fce6-210e-4f89-bac4-13bc4c12e99d', '6d602a98-1db5-4572-befa-9cdc90afec7d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:47:27 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Delete snapshot completed successfully. Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c330bdcb-38a1-4a5e-9883-f546b840ffbb tempest-SnapshotsActionsTest-713203512 None] Lock "cinder-c6474917-e4f0-4c54-942f-ece563dd3835-delete_snapshot" released by "delete_snapshot" :: held 2.592s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:27 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18" returned: 0 in 0.480s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:27 devstack sudo[96587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18 Aug 09 12:47:27 devstack sudo[96587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:28 devstack sudo[96587]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6de5750a-edc5-4458-9097-7fe2b8c6bf18" returned: 0 in 0.286s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Lock "cinder-quobyte-6de5750a-edc5-4458-9097-7fe2b8c6bf18" released by "delete_volume" :: held 0.824s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:28 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Created reservations ['0e0bf30f-6aab-4883-9606-6dbb6a0c8757', '83761cfe-14b8-48c1-93d5-3ff94bb67fee', 'd75ee222-ad00-4ffb-94eb-502edff9f44a', '786e7f1e-4c62-46e2-89af-239715f004da'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:47:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:28 devstack sudo[96590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:47:28 devstack sudo[96590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:28 devstack sudo[96590]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.686s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:47:29 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Deleted volume successfully. Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-622efe59-c644-46a4-91fb-7ff1d0f3bae2 tempest-VolumesActionsTest-463554358 None] Lock "cinder-6de5750a-edc5-4458-9097-7fe2b8c6bf18-delete_volume" released by "delete_volume" :: held 1.806s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Flow 'volume_create_manager' (56c0a125-7935-4bed-bf13-86fd63f55a22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9419dff4-9b0d-4599-add6-763bcff737b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9419dff4-9b0d-4599-add6-763bcff737b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1242925990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148d28e2-923a-4fc1-b5b6-b4b07355a237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9504a042ca54df3a488e4801d7a4715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:29Z,use_quota=True,user_id='b7ce60eb66354e22af0ecd6fed813168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8af5f6d-942c-49d2-a7f9-97bf06e6165d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8af5f6d-942c-49d2-a7f9-97bf06e6165d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10c3864-84ce-4f36-9ea7-b7107a9cf505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b10c3864-84ce-4f36-9ea7-b7107a9cf505) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '148d28e2-923a-4fc1-b5b6-b4b07355a237', 'volume_name': 'volume-148d28e2-923a-4fc1-b5b6-b4b07355a237', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dea8186-8c27-4375-b520-39f5d9112506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0dea8186-8c27-4375-b520-39f5d9112506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7180b4c8-3a1f-4f46-ae97-4e1c6d19ba4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:29 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Volume 148d28e2-923a-4fc1-b5b6-b4b07355a237: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-148d28e2-923a-4fc1-b5b6-b4b07355a237', 'volume_size': 1} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1242925990',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=148d28e2-923a-4fc1-b5b6-b4b07355a237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9504a042ca54df3a488e4801d7a4715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:29Z,use_quota=True,user_id='b7ce60eb66354e22af0ecd6fed813168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Creating volume 148d28e2-923a-4fc1-b5b6-b4b07355a237 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:47:29 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-148d28e2-923a-4fc1-b5b6-b4b07355a237 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Acquiring lock "cinder-63fdbd29-9e8c-4b70-937b-120975cf2a11-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:29 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-148d28e2-923a-4fc1-b5b6-b4b07355a237 1073741824 Aug 09 12:47:29 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Lock "cinder-63fdbd29-9e8c-4b70-937b-120975cf2a11-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Acquiring lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Acquiring lock "cinder-quobyte-63fdbd29-9e8c-4b70-937b-120975cf2a11" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Lock "cinder-quobyte-63fdbd29-9e8c-4b70-937b-120975cf2a11" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Deleting offline snapshot 63fdbd29-9e8c-4b70-937b-120975cf2a11 of volume 29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] snapshot_file for this snap is: volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf24c98-8af1-4bc5-a5e9-cc262ab8b9ba]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:30 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 Aug 09 12:47:30 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:30 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-148d28e2-923a-4fc1-b5b6-b4b07355a237 1073741824" returned: 0 in 0.873s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-148d28e2-923a-4fc1-b5b6-b4b07355a237 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:30 devstack sudo[96610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-148d28e2-923a-4fc1-b5b6-b4b07355a237 Aug 09 12:47:30 devstack sudo[96610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:30 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11" returned: 0 in 0.891s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:47:30 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f76483e-b073-40af-a2ec-319c03d35b5f]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:31 devstack sudo[96610]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-148d28e2-923a-4fc1-b5b6-b4b07355a237" returned: 0 in 0.523s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] <== create_volume: return (1476ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:47:31 devstack sudo[96615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e Aug 09 12:47:31 devstack sudo[96615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7180b4c8-3a1f-4f46-ae97-4e1c6d19ba4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-148d28e2-923a-4fc1-b5b6-b4b07355a237', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80eea8c5-7c68-4f32-8afe-eeb644f4b794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:31 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Volume volume-148d28e2-923a-4fc1-b5b6-b4b07355a237 (148d28e2-923a-4fc1-b5b6-b4b07355a237): created successfully Aug 09 12:47:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80eea8c5-7c68-4f32-8afe-eeb644f4b794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Flow 'volume_create_manager' (56c0a125-7935-4bed-bf13-86fd63f55a22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:31 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-30e48e8c-549d-421c-8bb9-62708e9b9d8d tempest-VolumesActionsTest-1646050885 None] Created volume successfully. Aug 09 12:47:31 devstack sudo[96615]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e" returned: 0 in 0.876s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:31 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 Aug 09 12:47:31 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Acquiring lock "cinder-148d28e2-923a-4fc1-b5b6-b4b07355a237-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Lock "cinder-148d28e2-923a-4fc1-b5b6-b4b07355a237-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Acquiring lock "cinder-quobyte-148d28e2-923a-4fc1-b5b6-b4b07355a237" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Lock "cinder-quobyte-148d28e2-923a-4fc1-b5b6-b4b07355a237" acquired by "delete_volume" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:32 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c33fb2f-49fb-478f-8213-abd3f979add7]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-148d28e2-923a-4fc1-b5b6-b4b07355a237 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:32 devstack sudo[96626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-148d28e2-923a-4fc1-b5b6-b4b07355a237 Aug 09 12:47:32 devstack sudo[96626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:32 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11" returned: 0 in 0.961s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:32 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11 Aug 09 12:47:32 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:33 devstack sudo[96626]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-148d28e2-923a-4fc1-b5b6-b4b07355a237" returned: 0 in 0.962s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-148d28e2-923a-4fc1-b5b6-b4b07355a237 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:33 devstack sudo[96650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-148d28e2-923a-4fc1-b5b6-b4b07355a237 Aug 09 12:47:33 devstack sudo[96650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:33 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e.63fdbd29-9e8c-4b70-937b-120975cf2a11" returned: 0 in 0.853s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Lock "cinder-quobyte-63fdbd29-9e8c-4b70-937b-120975cf2a11" released by "_delete_snapshot" :: held 3.945s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" released by "delete_snapshot" :: held 3.994s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:33 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Created reservations ['de2c6103-dd7a-460e-9d23-777aa589f35d', '0dd0667b-5a90-4b49-8777-05e0a73827e4', '494f655b-e712-47be-a4a4-2b5740d83155', 'c0694a6f-f5c0-4ef2-85a3-d5bf474804b4'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:47:34 devstack sudo[96650]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-148d28e2-923a-4fc1-b5b6-b4b07355a237" returned: 0 in 0.959s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Lock "cinder-quobyte-148d28e2-923a-4fc1-b5b6-b4b07355a237" released by "delete_volume" :: held 2.007s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:34 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Delete snapshot completed successfully. Aug 09 12:47:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ad9a038a-9a39-4f6e-9130-4939c4e0cba6 tempest-SnapshotsActionsTest-2090878900 None] Lock "cinder-63fdbd29-9e8c-4b70-937b-120975cf2a11-delete_snapshot" released by "delete_snapshot" :: held 4.448s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:34 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Created reservations ['9c6c8cab-8c74-4ef4-a62a-94866670f2be', '7d2cf269-960b-4932-88e0-fc9255250d9c', '2aa02ea6-4d8a-4af7-a133-22521ea879ca', '3f084cf7-e412-4c55-ac90-ce4fdab9cc3e'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:47:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:34 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:47:34 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:35 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.793s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:35 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:47:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Acquiring lock "cinder-29cccc3c-1bdc-42fc-906a-fb022a17d87e-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:35 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Deleted volume successfully. Aug 09 12:47:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Lock "cinder-29cccc3c-1bdc-42fc-906a-fb022a17d87e-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b84032c-faa0-4b6b-8865-b62e2cc53c31 tempest-VolumesActionsTest-463554358 None] Lock "cinder-148d28e2-923a-4fc1-b5b6-b4b07355a237-delete_volume" released by "delete_volume" :: held 3.347s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Acquiring lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" acquired by "delete_volume" :: waited 0.037s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:35 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[608f0ee5-4f3c-4608-8678-e36386cd7aaa]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:35 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e Aug 09 12:47:35 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Flow 'volume_create_manager' (9c347a48-55e0-4a1f-81a0-09eaf987a8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86872fd2-14c6-4a5d-a9c1-208c0a9117d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86872fd2-14c6-4a5d-a9c1-208c0a9117d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1519245448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc182af-6e8d-4dd5-bd8c-b21687ee62d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9504a042ca54df3a488e4801d7a4715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:36Z,use_quota=True,user_id='b7ce60eb66354e22af0ecd6fed813168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a16404-6575-4f3e-bfb5-cdd0d1294942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64a16404-6575-4f3e-bfb5-cdd0d1294942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8187f399-ae1e-4de9-a79a-a82072341162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8187f399-ae1e-4de9-a79a-a82072341162) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bc182af-6e8d-4dd5-bd8c-b21687ee62d0', 'volume_name': 'volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff25c47-64c0-428c-86a2-37d9472afeac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ff25c47-64c0-428c-86a2-37d9472afeac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da4b977-fdca-44a0-8f50-fcab6a7558bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:36 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Volume 0bc182af-6e8d-4dd5-bd8c-b21687ee62d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0', 'volume_size': 1} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1519245448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bc182af-6e8d-4dd5-bd8c-b21687ee62d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9504a042ca54df3a488e4801d7a4715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:36Z,use_quota=True,user_id='b7ce60eb66354e22af0ecd6fed813168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Creating volume 0bc182af-6e8d-4dd5-bd8c-b21687ee62d0 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:47:36 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:36 devstack sudo[96716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0 1073741824 Aug 09 12:47:36 devstack sudo[96716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:36 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e" returned: 0 in 1.022s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:36 devstack sudo[96721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e Aug 09 12:47:36 devstack sudo[96721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:37 devstack sudo[96721]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-29cccc3c-1bdc-42fc-906a-fb022a17d87e" returned: 0 in 0.449s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:37 devstack sudo[96716]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0 1073741824" returned: 0 in 0.811s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Lock "cinder-quobyte-29cccc3c-1bdc-42fc-906a-fb022a17d87e" released by "delete_volume" :: held 1.646s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:37 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0 Aug 09 12:47:37 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Created reservations ['9803a7db-1a56-423b-85ad-fc941e7beee0', '623e4d73-cfe6-44bf-8c0d-413c85e619aa', '926451a6-ff54-4151-93d8-3b0dd4eb3fb6', '0fe44944-4504-45ba-88d2-e176808b398d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:37 devstack sudo[96731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:47:37 devstack sudo[96731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:37 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0" returned: 0 in 0.655s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9da4b977-fdca-44a0-8f50-fcab6a7558bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f74d773-aed6-4b65-abbe-12399116ed6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:37 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Volume volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0 (0bc182af-6e8d-4dd5-bd8c-b21687ee62d0): created successfully Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f74d773-aed6-4b65-abbe-12399116ed6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Flow 'volume_create_manager' (9c347a48-55e0-4a1f-81a0-09eaf987a8e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:38 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e471d9eb-207b-4d5a-9b0a-b60044a9e70b tempest-VolumesActionsTest-1646050885 None] Created volume successfully. Aug 09 12:47:38 devstack sudo[96731]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.772s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:38 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:47:38 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Deleted volume successfully. Aug 09 12:47:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b2f5e04-e3f0-48fb-a9fb-8a49eea46a91 tempest-SnapshotsActionsTest-2090878900 None] Lock "cinder-29cccc3c-1bdc-42fc-906a-fb022a17d87e-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Acquiring lock "cinder-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Lock "cinder-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:38 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=110,cinder:SELECT=117,cinder:INSERT=32,cinder:DELETE=10 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:47:39 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=112,cinder:INSERT=33,cinder:UPDATE=109,cinder:DELETE=8 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:47:39 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Acquiring lock "cinder-quobyte-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:39 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Lock "cinder-quobyte-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0" acquired by "delete_volume" :: waited 0.050s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:39 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f4c4e6-3489-4fd4-8096-da7b51876d8e]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:39 devstack sudo[96737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0 Aug 09 12:47:39 devstack sudo[96737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:40 devstack sudo[96737]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0" returned: 0 in 0.912s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:40 devstack sudo[96763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0 Aug 09 12:47:40 devstack sudo[96763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:40 devstack sudo[96763]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0" returned: 0 in 0.667s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Lock "cinder-quobyte-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0" released by "delete_volume" :: held 1.663s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:40 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Created reservations ['a8830127-5ec4-4354-b74a-4ecf62ebcd2c', 'a1c9bbf8-9401-4fe2-8e66-996aa973571e', '40ab94ba-472e-4e6a-a283-5c5f09fab8d8', '05bbba5c-02eb-471f-8199-61ba99fba25b'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:47:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:41 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:47:41 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:41 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.587s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:41 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:47:41 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Deleted volume successfully. Aug 09 12:47:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-01984acc-d8e8-461c-b8ff-f211e5b12b52 tempest-VolumesActionsTest-463554358 None] Lock "cinder-0bc182af-6e8d-4dd5-bd8c-b21687ee62d0-delete_volume" released by "delete_volume" :: held 2.747s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:42 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Flow 'volume_create_manager' (fa3eda73-10e7-45a8-9c80-903482b5d7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7400435-f7f3-4f87-afa6-dfc76d27c836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7400435-f7f3-4f87-afa6-dfc76d27c836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1034779095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba01812-219f-4ab1-a72d-063f90d2e2ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9504a042ca54df3a488e4801d7a4715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:43Z,use_quota=True,user_id='b7ce60eb66354e22af0ecd6fed813168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84312ef-f003-4e42-b18d-76fdc8d3ff0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e84312ef-f003-4e42-b18d-76fdc8d3ff0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22577d3-2c31-4b80-b71d-b8ceeca8ae6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a22577d3-2c31-4b80-b71d-b8ceeca8ae6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cba01812-219f-4ab1-a72d-063f90d2e2ff', 'volume_name': 'volume-cba01812-219f-4ab1-a72d-063f90d2e2ff', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3d8570-1b68-4fd4-a4dc-4dfd08c72989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b3d8570-1b68-4fd4-a4dc-4dfd08c72989) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235fb45f-16e0-49bd-9c4e-64af0bf5f462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:43 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Volume cba01812-219f-4ab1-a72d-063f90d2e2ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cba01812-219f-4ab1-a72d-063f90d2e2ff', 'volume_size': 1} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:47:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1034779095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cba01812-219f-4ab1-a72d-063f90d2e2ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9504a042ca54df3a488e4801d7a4715',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:47:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:47:43Z,use_quota=True,user_id='b7ce60eb66354e22af0ecd6fed813168',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Creating volume cba01812-219f-4ab1-a72d-063f90d2e2ff {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:47:43 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:47:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-cba01812-219f-4ab1-a72d-063f90d2e2ff 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:43 devstack sudo[96831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-cba01812-219f-4ab1-a72d-063f90d2e2ff 1073741824 Aug 09 12:47:43 devstack sudo[96831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:44 devstack sudo[96831]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-cba01812-219f-4ab1-a72d-063f90d2e2ff 1073741824" returned: 0 in 1.081s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-1369de4c-7c53-4a89-960e-89b5ce964270 req-f6be7629-62b1-449f-a94d-e8c243c06d56 tempest-ServerActionsTestOtherA-978128034 None] Terminate volume connection completed successfully. Aug 09 12:47:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-1369de4c-7c53-4a89-960e-89b5ce964270 req-f6be7629-62b1-449f-a94d-e8c243c06d56 tempest-ServerActionsTestOtherA-978128034 None] Deleting attachment 100cff21-2fdf-4d73-86f6-58e1197af7f8. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:47:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-cba01812-219f-4ab1-a72d-063f90d2e2ff {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:44 devstack sudo[96860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-cba01812-219f-4ab1-a72d-063f90d2e2ff Aug 09 12:47:44 devstack sudo[96860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:44 devstack sudo[96860]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-cba01812-219f-4ab1-a72d-063f90d2e2ff" returned: 0 in 0.547s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:47:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.727s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235fb45f-16e0-49bd-9c4e-64af0bf5f462) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cba01812-219f-4ab1-a72d-063f90d2e2ff', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca9d310-5849-48a4-82ce-6296044b9f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:47:44 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Volume volume-cba01812-219f-4ab1-a72d-063f90d2e2ff (cba01812-219f-4ab1-a72d-063f90d2e2ff): created successfully Aug 09 12:47:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ca9d310-5849-48a4-82ce-6296044b9f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:47:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Flow 'volume_create_manager' (fa3eda73-10e7-45a8-9c80-903482b5d7a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:47:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c9e012a0-1857-43e4-a317-2fcaed620692 tempest-VolumesActionsTest-1646050885 None] Created volume successfully. Aug 09 12:47:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Acquiring lock "cinder-cba01812-219f-4ab1-a72d-063f90d2e2ff-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Lock "cinder-cba01812-219f-4ab1-a72d-063f90d2e2ff-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Acquiring lock "cinder-quobyte-cba01812-219f-4ab1-a72d-063f90d2e2ff" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:47:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Lock "cinder-quobyte-cba01812-219f-4ab1-a72d-063f90d2e2ff" acquired by "delete_volume" :: waited 0.049s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:47:47 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b795e0-7b08-4ffb-be3c-46e0fac2e3ad]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:47:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-cba01812-219f-4ab1-a72d-063f90d2e2ff {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:47 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-cba01812-219f-4ab1-a72d-063f90d2e2ff Aug 09 12:47:47 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:47 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-cba01812-219f-4ab1-a72d-063f90d2e2ff" returned: 0 in 0.598s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-cba01812-219f-4ab1-a72d-063f90d2e2ff {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:47 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-cba01812-219f-4ab1-a72d-063f90d2e2ff Aug 09 12:47:47 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-1369de4c-7c53-4a89-960e-89b5ce964270 req-8f38eddf-1194-428b-a179-237d0ea3475c tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-1369de4c-7c53-4a89-960e-89b5ce964270 req-8f38eddf-1194-428b-a179-237d0ea3475c tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-1369de4c-7c53-4a89-960e-89b5ce964270 req-8f38eddf-1194-428b-a179-237d0ea3475c tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-1369de4c-7c53-4a89-960e-89b5ce964270 req-8f38eddf-1194-428b-a179-237d0ea3475c tempest-ServerActionsTestOtherA-978128034 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '94afec1e-c53b-4e28-ba12-dbf7c4b9820f', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:47:47 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-cba01812-219f-4ab1-a72d-063f90d2e2ff" returned: 0 in 0.361s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Lock "cinder-quobyte-cba01812-219f-4ab1-a72d-063f90d2e2ff" released by "delete_volume" :: held 1.038s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-1369de4c-7c53-4a89-960e-89b5ce964270 req-8f38eddf-1194-428b-a179-237d0ea3475c tempest-ServerActionsTestOtherA-978128034 None] attachment_update completed successfully. Aug 09 12:47:48 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Created reservations ['b1c6c820-29bb-4733-ae7d-58352e3eca73', '0c49d8a0-27e7-4319-ac67-25940d210a97', '111f7bc9-adfd-4f5e-9756-a85501f64dc2', 'af3346ba-5810-4986-9f4c-be0c59229963'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:47:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:48 devstack sudo[96883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:47:48 devstack sudo[96883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.438s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:48 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:47:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Deleted volume successfully. Aug 09 12:47:48 devstack sudo[96883]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a34b0469-d82b-4765-95fc-caf1408fef9b tempest-VolumesActionsTest-1646050885 None] Lock "cinder-cba01812-219f-4ab1-a72d-063f90d2e2ff-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:47:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:47:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:47:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:47:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:47:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:47:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:47:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:47:57 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:47:57 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:47:58 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Aug 09 12:47:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.511s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:47:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:47:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:47:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:47:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:47:58 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=20,cinder:INSERT=4,cinder:UPDATE=21 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:47:58 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=18,cinder:INSERT=5,cinder:UPDATE=19,cinder:DELETE=3 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Flow 'volume_create_manager' (b8f89b5e-7a81-4b48-96c9-530d3f95aecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efc45f5-0691-4749-9606-79f735129bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1efc45f5-0691-4749-9606-79f735129bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-569727901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd94fcd-cdce-4714-ac88-be199e1827a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e9e8c401894c2d902628ba54b303fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:09Z,use_quota=True,user_id='fc1471f65e3a4436895b1515449bdf2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62766b1d-ac77-481e-b7a2-26da87e821fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62766b1d-ac77-481e-b7a2-26da87e821fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d6a6d7-7bda-4ea8-ad7b-f7c354bcb789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d6a6d7-7bda-4ea8-ad7b-f7c354bcb789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd94fcd-cdce-4714-ac88-be199e1827a4', 'volume_name': 'volume-9fd94fcd-cdce-4714-ac88-be199e1827a4', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f4e011-fe2d-4e9d-bf31-4bc4cb306c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18f4e011-fe2d-4e9d-bf31-4bc4cb306c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b2b0a8-3a0d-44aa-8c93-81553ca80e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:09 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Volume 9fd94fcd-cdce-4714-ac88-be199e1827a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd94fcd-cdce-4714-ac88-be199e1827a4', 'volume_size': 1} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-569727901',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd94fcd-cdce-4714-ac88-be199e1827a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47e9e8c401894c2d902628ba54b303fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:09Z,use_quota=True,user_id='fc1471f65e3a4436895b1515449bdf2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Creating volume 9fd94fcd-cdce-4714-ac88-be199e1827a4 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:48:09 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:48:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fd94fcd-cdce-4714-ac88-be199e1827a4 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:09 devstack sudo[97035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fd94fcd-cdce-4714-ac88-be199e1827a4 1073741824 Aug 09 12:48:09 devstack sudo[97035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:10 devstack sudo[97035]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fd94fcd-cdce-4714-ac88-be199e1827a4 1073741824" returned: 0 in 0.798s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fd94fcd-cdce-4714-ac88-be199e1827a4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:10 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fd94fcd-cdce-4714-ac88-be199e1827a4 Aug 09 12:48:10 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:10 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fd94fcd-cdce-4714-ac88-be199e1827a4" returned: 0 in 0.327s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:48:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69b2b0a8-3a0d-44aa-8c93-81553ca80e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd94fcd-cdce-4714-ac88-be199e1827a4', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c15dec-321b-4a5a-b00c-5f45fc2a2074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:10 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Volume volume-9fd94fcd-cdce-4714-ac88-be199e1827a4 (9fd94fcd-cdce-4714-ac88-be199e1827a4): created successfully Aug 09 12:48:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71c15dec-321b-4a5a-b00c-5f45fc2a2074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Flow 'volume_create_manager' (b8f89b5e-7a81-4b48-96c9-530d3f95aecc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:10 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-bfc1a702-7b32-4f47-b14e-2182bebe65c0 tempest-AbsoluteLimitsTests-1950532731 None] Created volume successfully. Aug 09 12:48:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Acquiring lock "cinder-9fd94fcd-cdce-4714-ac88-be199e1827a4-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Lock "cinder-9fd94fcd-cdce-4714-ac88-be199e1827a4-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Acquiring lock "cinder-quobyte-9fd94fcd-cdce-4714-ac88-be199e1827a4" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Lock "cinder-quobyte-9fd94fcd-cdce-4714-ac88-be199e1827a4" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:11 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc61f6c-5013-47c1-a553-760b4492373a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fd94fcd-cdce-4714-ac88-be199e1827a4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:11 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fd94fcd-cdce-4714-ac88-be199e1827a4 Aug 09 12:48:11 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:12 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fd94fcd-cdce-4714-ac88-be199e1827a4" returned: 0 in 0.429s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fd94fcd-cdce-4714-ac88-be199e1827a4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:12 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fd94fcd-cdce-4714-ac88-be199e1827a4 Aug 09 12:48:12 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:12 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fd94fcd-cdce-4714-ac88-be199e1827a4" returned: 0 in 0.277s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Lock "cinder-quobyte-9fd94fcd-cdce-4714-ac88-be199e1827a4" released by "delete_volume" :: held 0.770s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Created reservations ['aee9381e-beb5-4cdf-ba84-9a1f69bf9e40', 'e80a54e1-4d13-4824-8d1d-a9d55fcc0166', '7c632ee9-981c-4f2a-9b2d-822f95bfbb90', '4f910f8b-9644-4a48-96a8-fe075ab0a56d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:12 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:48:12 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:12 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.276s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:48:12 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Deleted volume successfully. Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-40336b02-70e2-466e-b2b0-a4710daf1410 tempest-AbsoluteLimitsTests-1950532731 None] Lock "cinder-9fd94fcd-cdce-4714-ac88-be199e1827a4-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:12 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-caf30155-c601-4f3e-bd2a-debc61c2ad28 req-15d9ed47-7903-4a41-b589-bc34f089862b tempest-AttachVolumeNegativeTest-1965921425 None] Terminate volume connection completed successfully. Aug 09 12:48:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-caf30155-c601-4f3e-bd2a-debc61c2ad28 req-15d9ed47-7903-4a41-b589-bc34f089862b tempest-AttachVolumeNegativeTest-1965921425 None] Deleting attachment 75e4865f-bd72-491a-bf95-b88fc1c2d10f. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Flow 'volume_create_manager' (3f7472b3-8c04-4fb5-baae-05d66306189d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0b8d3c-4a0e-4f22-94f1-682fd40dd555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c0b8d3c-4a0e-4f22-94f1-682fd40dd555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1121105859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98c8a83-ff36-432c-ba67-f4a9ad5c8426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e961123920ac4f90bafb11ead898d2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:16Z,use_quota=True,user_id='cd55c074133b4da08efc38970435b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deabfc3e-b6d1-4b92-bd4f-c7becf0b351b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (deabfc3e-b6d1-4b92-bd4f-c7becf0b351b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577bf7a8-6997-49d3-831a-cbf905faaa9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (577bf7a8-6997-49d3-831a-cbf905faaa9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e98c8a83-ff36-432c-ba67-f4a9ad5c8426', 'volume_name': 'volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e70b42-2af7-44ae-ad72-db953570b396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59e70b42-2af7-44ae-ad72-db953570b396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd004766-56f9-411b-b7ee-1d585d85ecd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:15 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Volume e98c8a83-ff36-432c-ba67-f4a9ad5c8426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426', 'volume_size': 1} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1121105859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e98c8a83-ff36-432c-ba67-f4a9ad5c8426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e961123920ac4f90bafb11ead898d2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:16Z,use_quota=True,user_id='cd55c074133b4da08efc38970435b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Creating volume e98c8a83-ff36-432c-ba67-f4a9ad5c8426 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:48:15 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:48:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:15 devstack sudo[97103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426 1073741824 Aug 09 12:48:15 devstack sudo[97103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:16 devstack sudo[97103]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426 1073741824" returned: 0 in 0.545s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:16 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426 Aug 09 12:48:16 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:16 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426" returned: 0 in 0.267s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:48:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd004766-56f9-411b-b7ee-1d585d85ecd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3336d842-4648-459f-8606-5b0d1d14f4dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:16 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Volume volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426 (e98c8a83-ff36-432c-ba67-f4a9ad5c8426): created successfully Aug 09 12:48:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3336d842-4648-459f-8606-5b0d1d14f4dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Flow 'volume_create_manager' (3f7472b3-8c04-4fb5-baae-05d66306189d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1c77bb07-0cd1-41da-a49a-f8623d44248f tempest-VolumeQuotasAdminTestJSON-981205656 None] Created volume successfully. Aug 09 12:48:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Acquiring lock "cinder-e98c8a83-ff36-432c-ba67-f4a9ad5c8426-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "cinder-e98c8a83-ff36-432c-ba67-f4a9ad5c8426-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Acquiring lock "cinder-quobyte-e98c8a83-ff36-432c-ba67-f4a9ad5c8426" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "cinder-quobyte-e98c8a83-ff36-432c-ba67-f4a9ad5c8426" acquired by "delete_volume" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e536e1a3-3a2c-40c3-bbdd-2f6116129c31]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:18 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426 Aug 09 12:48:18 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:18 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426" returned: 0 in 0.551s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:18 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426 Aug 09 12:48:18 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Flow 'volume_create_manager' (a3d25ae4-41bb-4cc4-a53e-daa6bb7314e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e289097-ffcf-4096-80d5-189f00f8fc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e289097-ffcf-4096-80d5-189f00f8fc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-112272644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f8bda6-3d5b-45a2-a616-4bd14d6e6624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba1a3808dcf49dfa1bdad245b838af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:19Z,use_quota=True,user_id='0eec808db65f4263bf6246b5d550518d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410d5ec6-af60-4f39-b2f5-ff26fd838380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (410d5ec6-af60-4f39-b2f5-ff26fd838380) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938b2307-f573-4cab-9cd7-8c0b80583d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (938b2307-f573-4cab-9cd7-8c0b80583d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79f8bda6-3d5b-45a2-a616-4bd14d6e6624', 'volume_name': 'volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb519f98-6425-4894-a237-ac9f469a6ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb519f98-6425-4894-a237-ac9f469a6ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c48eb0b-de32-4e6a-a762-cc8a0c3fbe91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:18 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Volume 79f8bda6-3d5b-45a2-a616-4bd14d6e6624: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624', 'volume_size': 1} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-112272644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79f8bda6-3d5b-45a2-a616-4bd14d6e6624,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba1a3808dcf49dfa1bdad245b838af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:19Z,use_quota=True,user_id='0eec808db65f4263bf6246b5d550518d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Creating volume 79f8bda6-3d5b-45a2-a616-4bd14d6e6624 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:48:18 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:18 devstack sudo[97119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 1073741824 Aug 09 12:48:18 devstack sudo[97119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:18 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e98c8a83-ff36-432c-ba67-f4a9ad5c8426" returned: 0 in 0.361s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "cinder-quobyte-e98c8a83-ff36-432c-ba67-f4a9ad5c8426" released by "delete_volume" :: held 0.994s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Created reservations ['a46b847c-2bfd-4492-b8d9-ce98be1b553c', '78c684ab-992d-402f-8ec5-b9ed77c71f06', '093c26eb-8271-406a-a2c2-c5b9f8b2d303', 'd06e3c26-d13b-4e46-829e-9c3086c07b3d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:19 devstack sudo[97125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:48:19 devstack sudo[97125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:19 devstack sudo[97119]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 1073741824" returned: 0 in 0.624s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:19 devstack sudo[97125]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.290s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:48:19 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Deleted volume successfully. Aug 09 12:48:19 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 Aug 09 12:48:19 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8062f66e-9cec-4b65-8261-d893accf35c1 tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "cinder-e98c8a83-ff36-432c-ba67-f4a9ad5c8426-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:19 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" returned: 0 in 0.280s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c48eb0b-de32-4e6a-a762-cc8a0c3fbe91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba616fc-e39e-423f-84d3-de72d02fb01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:19 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Volume volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 (79f8bda6-3d5b-45a2-a616-4bd14d6e6624): created successfully Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba616fc-e39e-423f-84d3-de72d02fb01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Flow 'volume_create_manager' (a3d25ae4-41bb-4cc4-a53e-daa6bb7314e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:19 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-71cee7c8-b1e7-4048-a41a-c771755d4134 tempest-VolumesDeleteCascade-1993538286 None] Created volume successfully. Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Flow 'volume_create_manager' (8ca598be-012a-497e-8e9a-1fa762c5649f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08fec1a-9a02-4b27-b80e-fa3fa08efe33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08fec1a-9a02-4b27-b80e-fa3fa08efe33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-814439264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0650d234-7048-4a42-9680-c93d41651bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e961123920ac4f90bafb11ead898d2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:21Z,use_quota=True,user_id='cd55c074133b4da08efc38970435b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2f502f-ed47-46c5-a1d6-95815bea74d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c2f502f-ed47-46c5-a1d6-95815bea74d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5408502-3c45-4d4f-8fad-2ac1c63ae22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5408502-3c45-4d4f-8fad-2ac1c63ae22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0650d234-7048-4a42-9680-c93d41651bec', 'volume_name': 'volume-0650d234-7048-4a42-9680-c93d41651bec', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec97114-ffb0-4958-b44f-86a57ea22615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fec97114-ffb0-4958-b44f-86a57ea22615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb7978b-7f94-43c0-8a84-3f366bdd7b88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:20 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Volume 0650d234-7048-4a42-9680-c93d41651bec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0650d234-7048-4a42-9680-c93d41651bec', 'volume_size': 1} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-814439264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0650d234-7048-4a42-9680-c93d41651bec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e961123920ac4f90bafb11ead898d2b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:21Z,use_quota=True,user_id='cd55c074133b4da08efc38970435b2d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Creating volume 0650d234-7048-4a42-9680-c93d41651bec {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:48:20 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0650d234-7048-4a42-9680-c93d41651bec 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:20 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0650d234-7048-4a42-9680-c93d41651bec 1073741824 Aug 09 12:48:20 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:21 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0650d234-7048-4a42-9680-c93d41651bec 1073741824" returned: 0 in 0.575s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0650d234-7048-4a42-9680-c93d41651bec {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:21 devstack sudo[97154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0650d234-7048-4a42-9680-c93d41651bec Aug 09 12:48:21 devstack sudo[97154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:21 devstack sudo[97154]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0650d234-7048-4a42-9680-c93d41651bec" returned: 0 in 0.319s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:48:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.879s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2eb7978b-7f94-43c0-8a84-3f366bdd7b88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0650d234-7048-4a42-9680-c93d41651bec', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1e89df-7580-4a06-b31a-3241eb00f06e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] Creating offline snapshot 455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 of volume 79f8bda6-3d5b-45a2-a616-4bd14d6e6624 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:48:21 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Volume volume-0650d234-7048-4a42-9680-c93d41651bec (0650d234-7048-4a42-9680-c93d41651bec): created successfully Aug 09 12:48:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1e89df-7580-4a06-b31a-3241eb00f06e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Flow 'volume_create_manager' (8ca598be-012a-497e-8e9a-1fa762c5649f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:21 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e0e2b6-7947-40be-9faf-01864f3874fe]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:21 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-91881fb7-b2b3-4e8b-b407-d6e621d6d971 tempest-VolumeQuotasAdminTestJSON-981205656 None] Created volume successfully. Aug 09 12:48:22 devstack sudo[97163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 Aug 09 12:48:22 devstack sudo[97163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:22 devstack sudo[97163]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" returned: 0 in 0.663s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:22 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 1G Aug 09 12:48:22 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:23 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 1G" returned: 0 in 0.668s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:23 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 Aug 09 12:48:23 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:23 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82" returned: 0 in 0.524s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:23 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 is being set with open permissions: ugo+rw Aug 09 12:48:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:23 devstack sudo[97207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 Aug 09 12:48:23 devstack sudo[97207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:23 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-8e2bb5ea-fe22-4dae-815e-28c08cef4913 tempest-ServerActionsTestOtherA-978128034 None] Terminate volume connection completed successfully. Aug 09 12:48:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-8e2bb5ea-fe22-4dae-815e-28c08cef4913 tempest-ServerActionsTestOtherA-978128034 None] Deleting attachment 94afec1e-c53b-4e28-ba12-dbf7c4b9820f. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:48:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "cinder-f8e66cb0-4e05-4a59-a96d-6b113120da5a-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:24 devstack sudo[97207]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82" returned: 0 in 0.485s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Lock "cinder-f8e66cb0-4e05-4a59-a96d-6b113120da5a-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:24 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-114377c8-2534-45e8-82a0-1c2d4327a55f tempest-VolumeQuotasAdminTestJSON-325821310 None] Transfer volume completed successfully. Aug 09 12:48:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:24 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.info Aug 09 12:48:24 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "cinder-quobyte-f8e66cb0-4e05-4a59-a96d-6b113120da5a" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Lock "cinder-quobyte-f8e66cb0-4e05-4a59-a96d-6b113120da5a" acquired by "delete_volume" :: waited 0.025s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:24 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce70609-2e24-4350-ac8b-c3e31e87c727]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:24 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a Aug 09 12:48:24 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:24 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.info" returned: 0 in 0.610s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:24 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.info is being set with open permissions: ugo+rw Aug 09 12:48:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:25 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.info Aug 09 12:48:25 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:25 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a" returned: 0 in 0.702s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Acquiring lock "cinder-0650d234-7048-4a42-9680-c93d41651bec-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:25 devstack sudo[97234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a Aug 09 12:48:25 devstack sudo[97234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Lock "cinder-0650d234-7048-4a42-9680-c93d41651bec-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Acquiring lock "cinder-quobyte-0650d234-7048-4a42-9680-c93d41651bec" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Lock "cinder-quobyte-0650d234-7048-4a42-9680-c93d41651bec" acquired by "delete_volume" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaed2a67-052f-4c54-b9c4-86a803f1a95e]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0650d234-7048-4a42-9680-c93d41651bec {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:25 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.info" returned: 0 in 0.407s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.523s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:25 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-61d88fff-7056-480a-9e38-8837b8ebea06 tempest-VolumesDeleteCascade-1993538286 None] Create snapshot completed successfully Aug 09 12:48:25 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0650d234-7048-4a42-9680-c93d41651bec Aug 09 12:48:25 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:25 devstack sudo[97234]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f8e66cb0-4e05-4a59-a96d-6b113120da5a" returned: 0 in 0.345s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Lock "cinder-quobyte-f8e66cb0-4e05-4a59-a96d-6b113120da5a" released by "delete_volume" :: held 1.096s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG cinder.quota [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Created reservations ['15d1cdf4-a4fc-4a2a-bf25-abb585a10db1', 'dbbdad5a-e115-45d1-84a4-a708ce2e9df0', 'ccb3149f-929e-4e22-a9b9-09b04dfee305', '25d6834d-c3bd-45c6-aba4-1bd95d11f963'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:25 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:48:25 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:25 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0650d234-7048-4a42-9680-c93d41651bec" returned: 0 in 0.418s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0650d234-7048-4a42-9680-c93d41651bec {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:25 devstack sudo[97245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0650d234-7048-4a42-9680-c93d41651bec Aug 09 12:48:25 devstack sudo[97245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:25 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.295s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:25 devstack cinder-volume[89309]: DEBUG cinder.manager [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:48:25 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Deleted volume successfully. Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-7d6bf103-32c3-43b9-b83f-7c82755fe858 req-abdfb726-5fcc-4a5c-8e9f-61667b6b43d8 tempest-ServerActionsTestOtherA-978128034 None] Lock "cinder-f8e66cb0-4e05-4a59-a96d-6b113120da5a-delete_volume" released by "delete_volume" :: held 1.726s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:26 devstack sudo[97245]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0650d234-7048-4a42-9680-c93d41651bec" returned: 0 in 0.322s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Lock "cinder-quobyte-0650d234-7048-4a42-9680-c93d41651bec" released by "delete_volume" :: held 0.781s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "cinder-14b1ff99-f7a9-43e6-8204-306b423777a6-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Lock "cinder-14b1ff99-f7a9-43e6-8204-306b423777a6-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Created reservations ['d22326e2-0965-4cc1-b05d-ad20d2ab0450', '6e4d003c-0c6b-4637-bcf8-d6740d6b902c', 'e5d22676-875f-4cb8-b490-9f6227d806da', '3ffe0e69-5213-4dca-95b1-0993891af688'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "cinder-quobyte-14b1ff99-f7a9-43e6-8204-306b423777a6" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Lock "cinder-quobyte-14b1ff99-f7a9-43e6-8204-306b423777a6" acquired by "delete_volume" :: waited 0.031s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[69c313cc-33d2-434c-86db-b6a5e05a6e8f]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-14b1ff99-f7a9-43e6-8204-306b423777a6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:26 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:48:26 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:26 devstack sudo[97250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-14b1ff99-f7a9-43e6-8204-306b423777a6 Aug 09 12:48:26 devstack sudo[97250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] Creating offline snapshot 8044683a-a165-4670-9605-7443acdcaf95 of volume 79f8bda6-3d5b-45a2-a616-4bd14d6e6624 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d461dd70-827e-4c8c-a67f-afecbceb424f]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:26 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.455s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:48:26 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Deleted volume successfully. Aug 09 12:48:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-96978200-0c8f-4787-847d-2478a1453082 tempest-VolumeQuotasAdminTestJSON-1492860625 None] Lock "cinder-0650d234-7048-4a42-9680-c93d41651bec-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:26 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 Aug 09 12:48:26 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:27 devstack sudo[97250]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-14b1ff99-f7a9-43e6-8204-306b423777a6" returned: 0 in 0.881s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-14b1ff99-f7a9-43e6-8204-306b423777a6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:27 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-14b1ff99-f7a9-43e6-8204-306b423777a6 Aug 09 12:48:27 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:27 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82" returned: 0 in 0.800s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:48:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:27 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 1G Aug 09 12:48:27 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:27 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-14b1ff99-f7a9-43e6-8204-306b423777a6" returned: 0 in 0.649s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Lock "cinder-quobyte-14b1ff99-f7a9-43e6-8204-306b423777a6" released by "delete_volume" :: held 1.631s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:28 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Created reservations ['cfd28c2c-e181-4fa0-b19f-67b14bb23ca1', '19c2b6a5-1672-4902-aa12-5a32f7a9c0cc', '22f7f5ec-3681-4e27-a778-52873cdb3324', '36f5c7cb-8069-4b3b-8a28-4ce4ebbc6c62'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:48:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:28 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:48:28 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:28 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.362s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:28 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:48:28 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Deleted volume successfully. Aug 09 12:48:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-060246f6-4db1-4e42-b908-bc28565721f0 tempest-ServerActionsTestOtherA-978128034 None] Lock "cinder-14b1ff99-f7a9-43e6-8204-306b423777a6-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:28 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 1G" returned: 0 in 1.168s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:28 devstack sudo[97345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 Aug 09 12:48:28 devstack sudo[97345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:29 devstack sudo[97345]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95" returned: 0 in 0.478s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:29 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 is being set with open permissions: ugo+rw Aug 09 12:48:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:29 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 Aug 09 12:48:29 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:29 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95" returned: 0 in 0.493s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.088s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:29 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-19f41e85-6ba7-4beb-8528-b7dca3ca60d2 tempest-VolumesDeleteCascade-1993538286 None] Create snapshot completed successfully Aug 09 12:48:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-79f8bda6-3d5b-45a2-a616-4bd14d6e6624-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-79f8bda6-3d5b-45a2-a616-4bd14d6e6624-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Performing cascade delete. {{(pid=89309) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 09 12:48:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-quobyte-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-quobyte-455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Deleting offline snapshot 455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 of volume 79f8bda6-3d5b-45a2-a616-4bd14d6e6624 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:48:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] snapshot_file for this snap is: volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:48:30 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3d20b2a-6d79-46f4-be13-0fda8871383f]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:30 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 Aug 09 12:48:30 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:31 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82" returned: 0 in 0.869s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:48:31 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f6339e-f38a-493d-a106-5079fe853c0f]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:31 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 Aug 09 12:48:31 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:31 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" returned: 0 in 0.616s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:32 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2f50d2-2ba9-4bdb-8640-b501539cc29d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:32 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 Aug 09 12:48:32 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:32 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95" returned: 0 in 0.566s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:48:32 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d35e01e4-a12f-417a-86ae-2d7c2ffc72ee]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:32 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 Aug 09 12:48:32 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:33 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82" returned: 0 in 0.742s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:48:33 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb1bd3f7-b0a1-4187-b20b-09d681b7c3d6]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:33 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 Aug 09 12:48:33 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:33 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" returned: 0 in 0.553s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:33 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 Aug 09 12:48:33 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:34 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82" returned: 0 in 0.527s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:34 devstack sudo[97441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82 Aug 09 12:48:34 devstack sudo[97441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:34 devstack sudo[97441]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82" returned: 0 in 0.470s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 -F qcow2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:34 devstack sudo[97478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 -F qcow2 Aug 09 12:48:34 devstack sudo[97478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:35 devstack sudo[97478]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 -F qcow2" returned: 0 in 0.516s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82" released by "_delete_snapshot" :: held 5.257s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" released by "delete_snapshot" :: held 5.297s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Created reservations ['5aa0cf89-6345-4a51-9c9e-c08e64da67b6', 'ac63ab3a-ce9b-4ea8-9610-0984e2b757db', '592ef862-fb30-4e5a-866e-7addb41fedf8', '838ea03f-b3a9-4a3f-b30e-6b5ce0d57446'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:48:35 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Delete snapshot completed successfully. Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-455ae9e9-7652-4f8a-ba2d-b4b81f5c0c82-delete_snapshot" released by "delete_snapshot" :: held 5.502s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-8044683a-a165-4670-9605-7443acdcaf95-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-8044683a-a165-4670-9605-7443acdcaf95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-quobyte-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-quobyte-8044683a-a165-4670-9605-7443acdcaf95" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-8044683a-a165-4670-9605-7443acdcaf95" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Deleting offline snapshot 8044683a-a165-4670-9605-7443acdcaf95 of volume 79f8bda6-3d5b-45a2-a616-4bd14d6e6624 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] snapshot_file for this snap is: volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[de6c355e-ed20-493a-87ea-36b1584ad731]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:35 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 Aug 09 12:48:35 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:36 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95" returned: 0 in 0.507s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:48:36 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6cbc6c8-79c4-4d7d-94b0-22056b636b44]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:36 devstack sudo[97491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 Aug 09 12:48:36 devstack sudo[97491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:36 devstack sudo[97491]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" returned: 0 in 0.607s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:37 devstack sudo[97496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 Aug 09 12:48:37 devstack sudo[97496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:37 devstack sudo[97496]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95" returned: 0 in 0.542s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:37 devstack sudo[97504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95 Aug 09 12:48:37 devstack sudo[97504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:37 devstack sudo[97504]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624.8044683a-a165-4670-9605-7443acdcaf95" returned: 0 in 0.282s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-8044683a-a165-4670-9605-7443acdcaf95" released by "_delete_snapshot" :: held 2.113s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" released by "delete_snapshot" :: held 2.158s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:37 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Created reservations ['ccb28699-b7e1-4276-afe8-1f6e5247eb63', 'd97ea891-596d-4aec-8126-0a5bbb4b91e3', '6dbdfe0f-c65b-40ec-9d33-71b56282b0a8', '1ad4ed5c-786c-40ed-bfe3-b56b18148814'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:48:38 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Delete snapshot completed successfully. Aug 09 12:48:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-8044683a-a165-4670-9605-7443acdcaf95-delete_snapshot" released by "delete_snapshot" :: held 2.382s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Snapshots deleted, issuing volume delete {{(pid=89309) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 09 12:48:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-quobyte-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:38 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[affb5d4c-a477-4000-8c39-5468873e3fa4]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:38 devstack sudo[97507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 Aug 09 12:48:38 devstack sudo[97507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:38 devstack sudo[97507]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" returned: 0 in 0.486s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:38 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624 Aug 09 12:48:38 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:38 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" returned: 0 in 0.314s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-79f8bda6-3d5b-45a2-a616-4bd14d6e6624" released by "delete_volume" :: held 0.870s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:39 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Created reservations ['1b07133a-85c0-4854-ad3b-8a308acc831a', '55b68764-f14c-439c-ba01-efca13c232c6', '18be10f9-3aab-4d04-bb75-955294f320df', '70b7c6a6-28c7-462c-a5c7-b03fa515ec0a'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:48:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:39 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:48:39 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:39 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.388s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:39 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:48:39 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Deleted volume successfully. Aug 09 12:48:39 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b31ddb67-2076-42bf-ba9b-cb421af0f77d tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-79f8bda6-3d5b-45a2-a616-4bd14d6e6624-delete_volume" released by "delete_volume" :: held 9.509s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Flow 'volume_create_manager' (da6d70af-a8cd-442a-9e2a-284b2e7f778c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e807c9-a572-4101-b4a9-a5f03d2db054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7e807c9-a572-4101-b4a9-a5f03d2db054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1867941796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e31629-cc8e-4b93-9914-3666c9223323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba1a3808dcf49dfa1bdad245b838af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:40Z,use_quota=True,user_id='0eec808db65f4263bf6246b5d550518d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129f69b8-b81f-40b7-a0ca-202ae15b6bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (129f69b8-b81f-40b7-a0ca-202ae15b6bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20aea07a-b528-4349-a783-374784d30d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20aea07a-b528-4349-a783-374784d30d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9e31629-cc8e-4b93-9914-3666c9223323', 'volume_name': 'volume-b9e31629-cc8e-4b93-9914-3666c9223323', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016d958e-9978-44f0-9e61-58994d12a19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (016d958e-9978-44f0-9e61-58994d12a19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef02015f-df49-44c7-8066-2bbac975cdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:40 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Volume b9e31629-cc8e-4b93-9914-3666c9223323: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9e31629-cc8e-4b93-9914-3666c9223323', 'volume_size': 1} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1867941796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9e31629-cc8e-4b93-9914-3666c9223323,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba1a3808dcf49dfa1bdad245b838af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:40Z,use_quota=True,user_id='0eec808db65f4263bf6246b5d550518d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Creating volume b9e31629-cc8e-4b93-9914-3666c9223323 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:48:40 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:40 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 1073741824 Aug 09 12:48:40 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Flow 'volume_create_manager' (fd0c166a-fc58-462c-bf9b-968e31ede8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbed57b-c873-4229-acec-19b7fc99324e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbbed57b-c873-4229-acec-19b7fc99324e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-168283392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66d546b-22cc-454a-85fa-438f85572792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a90c4790c2e4867b49d12b4837b9f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:40Z,use_quota=True,user_id='4eb85d565d0044b0b7058afa25c30747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912bf927-6ee5-4bc0-aa53-57761cf31d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (912bf927-6ee5-4bc0-aa53-57761cf31d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a836d152-fc7f-41d3-946c-da413c6e096f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a836d152-fc7f-41d3-946c-da413c6e096f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a66d546b-22cc-454a-85fa-438f85572792', 'volume_name': 'volume-a66d546b-22cc-454a-85fa-438f85572792', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05124308-86f7-41b6-b907-3c3c4b04148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05124308-86f7-41b6-b907-3c3c4b04148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c06a67-5d71-4e85-949a-c36cc32b7bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:40 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Volume a66d546b-22cc-454a-85fa-438f85572792: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a66d546b-22cc-454a-85fa-438f85572792', 'volume_size': 1} Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:40 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 1073741824" returned: 0 in 0.596s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:41 devstack sudo[97528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 Aug 09 12:48:41 devstack sudo[97528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:41 devstack sudo[97528]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323" returned: 0 in 0.256s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] <== create_volume: return (915ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.774s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-168283392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a66d546b-22cc-454a-85fa-438f85572792,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a90c4790c2e4867b49d12b4837b9f1a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:40Z,use_quota=True,user_id='4eb85d565d0044b0b7058afa25c30747',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Creating volume a66d546b-22cc-454a-85fa-438f85572792 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:48:41 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a66d546b-22cc-454a-85fa-438f85572792 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef02015f-df49-44c7-8066-2bbac975cdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9e31629-cc8e-4b93-9914-3666c9223323', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4dbb1a-b55d-4984-9e36-bf00723c92b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:41 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a66d546b-22cc-454a-85fa-438f85572792 1073741824 Aug 09 12:48:41 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:41 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Volume volume-b9e31629-cc8e-4b93-9914-3666c9223323 (b9e31629-cc8e-4b93-9914-3666c9223323): created successfully Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e4dbb1a-b55d-4984-9e36-bf00723c92b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Flow 'volume_create_manager' (da6d70af-a8cd-442a-9e2a-284b2e7f778c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:41 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-7083b904-47fa-465e-8994-11aa28c9138c tempest-VolumesDeleteCascade-1993538286 None] Created volume successfully. Aug 09 12:48:41 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a66d546b-22cc-454a-85fa-438f85572792 1073741824" returned: 0 in 0.535s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a66d546b-22cc-454a-85fa-438f85572792 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:41 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a66d546b-22cc-454a-85fa-438f85572792 Aug 09 12:48:41 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:42 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a66d546b-22cc-454a-85fa-438f85572792" returned: 0 in 0.399s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] <== create_volume: return (1019ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3c06a67-5d71-4e85-949a-c36cc32b7bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a66d546b-22cc-454a-85fa-438f85572792', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca150d10-b91c-44f7-bb59-f09199392431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:42 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Volume volume-a66d546b-22cc-454a-85fa-438f85572792 (a66d546b-22cc-454a-85fa-438f85572792): created successfully Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca150d10-b91c-44f7-bb59-f09199392431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Flow 'volume_create_manager' (fd0c166a-fc58-462c-bf9b-968e31ede8b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:42 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-153dbcbb-884d-45bd-ab8a-44b3ae856d32 tempest-VolumesServicesTestJSON-101414750 None] Created volume successfully. Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] Creating offline snapshot 6f1602cf-0284-414a-8f3d-1cba91fac887 of volume b9e31629-cc8e-4b93-9914-3666c9223323 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d68a9bd-554c-48ce-88ff-64cc064cdbe4]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:42 devstack sudo[97539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 Aug 09 12:48:42 devstack sudo[97539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:42 devstack sudo[97539]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323" returned: 0 in 0.394s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:42 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 1G Aug 09 12:48:42 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:43 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 1G" returned: 0 in 0.564s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e31629-cc8e-4b93-9914-3666c9223323 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:43 devstack sudo[97568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e31629-cc8e-4b93-9914-3666c9223323 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 Aug 09 12:48:43 devstack sudo[97568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Acquiring lock "cinder-a66d546b-22cc-454a-85fa-438f85572792-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Lock "cinder-a66d546b-22cc-454a-85fa-438f85572792-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Acquiring lock "cinder-quobyte-a66d546b-22cc-454a-85fa-438f85572792" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Lock "cinder-quobyte-a66d546b-22cc-454a-85fa-438f85572792" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:43 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[24bb6d8b-ba91-4088-b946-b3b0cd777ab5]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a66d546b-22cc-454a-85fa-438f85572792 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:43 devstack sudo[97568]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9e31629-cc8e-4b93-9914-3666c9223323 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887" returned: 0 in 0.376s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:43 devstack sudo[97571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a66d546b-22cc-454a-85fa-438f85572792 Aug 09 12:48:43 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 is being set with open permissions: ugo+rw Aug 09 12:48:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:43 devstack sudo[97571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:43 devstack sudo[97575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 Aug 09 12:48:43 devstack sudo[97575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:44 devstack sudo[97575]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887" returned: 0 in 0.255s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:44 devstack sudo[97571]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a66d546b-22cc-454a-85fa-438f85572792" returned: 0 in 0.423s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a66d546b-22cc-454a-85fa-438f85572792 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:44 devstack sudo[97582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a66d546b-22cc-454a-85fa-438f85572792 Aug 09 12:48:44 devstack sudo[97582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:44 devstack sudo[97583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.info Aug 09 12:48:44 devstack sudo[97583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:44 devstack sudo[97582]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a66d546b-22cc-454a-85fa-438f85572792" returned: 0 in 0.285s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Lock "cinder-quobyte-a66d546b-22cc-454a-85fa-438f85572792" released by "delete_volume" :: held 0.763s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:44 devstack sudo[97583]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.info" returned: 0 in 0.321s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:44 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.info is being set with open permissions: ugo+rw Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:44 devstack sudo[97588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.info Aug 09 12:48:44 devstack sudo[97588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Created reservations ['75dcd74e-6613-467a-b719-714af7e751c8', '571c2943-48ee-403d-a98e-9c488fda4d0d', 'f179c43d-1dff-4e49-ba8b-9de9a4fd38b9', '715faf01-816e-419f-859a-910b8f8a30e7'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:44 devstack sudo[97590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:48:44 devstack sudo[97590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:44 devstack sudo[97588]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.info" returned: 0 in 0.333s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a4954354-f022-499d-9468-50697c009719 tempest-VolumesDeleteCascade-1993538286 None] Create snapshot completed successfully Aug 09 12:48:44 devstack sudo[97590]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.326s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:48:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Deleted volume successfully. Aug 09 12:48:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-328c8bdb-e654-4013-8ee0-44c84338e582 tempest-VolumesServicesTestJSON-101414750 None] Lock "cinder-a66d546b-22cc-454a-85fa-438f85572792-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Flow 'volume_create_manager' (31a917b9-771b-4a69-a578-e8b2743d981e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6fc477-041a-4c23-8aec-cd7bde569aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b6fc477-041a-4c23-8aec-cd7bde569aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1636249571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40853471-e3a4-4c91-862e-95dcf1e8c637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bba1a3808dcf49dfa1bdad245b838af4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6f1602cf-0284-414a-8f3d-1cba91fac887,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:46Z,use_quota=True,user_id='0eec808db65f4263bf6246b5d550518d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4ad26a-48ab-451f-84c6-40fa4103c065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce4ad26a-48ab-451f-84c6-40fa4103c065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b631bcd-45a8-4987-a7f3-29cd65f06cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b631bcd-45a8-4987-a7f3-29cd65f06cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40853471-e3a4-4c91-862e-95dcf1e8c637', 'volume_name': 'volume-40853471-e3a4-4c91-862e-95dcf1e8c637', 'volume_size': 1, 'snapshot_id': '6f1602cf-0284-414a-8f3d-1cba91fac887'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad8c4bf-babf-4b1b-a6a3-f923e8dae294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad8c4bf-babf-4b1b-a6a3-f923e8dae294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99661312-9ed1-4ad9-a028-ccfa35035ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:46 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Volume 40853471-e3a4-4c91-862e-95dcf1e8c637: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40853471-e3a4-4c91-862e-95dcf1e8c637', 'volume_size': 1, 'snapshot_id': '6f1602cf-0284-414a-8f3d-1cba91fac887'} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-quobyte-6f1602cf-0284-414a-8f3d-1cba91fac887-40853471-e3a4-4c91-862e-95dcf1e8c637" by "_create_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-6f1602cf-0284-414a-8f3d-1cba91fac887-40853471-e3a4-4c91-862e-95dcf1e8c637" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Creating volume 40853471-e3a4-4c91-862e-95dcf1e8c637 from snapshot 6f1602cf-0284-414a-8f3d-1cba91fac887 {{(pid=89309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-quobyte-40853471-e3a4-4c91-862e-95dcf1e8c637" by "_copy_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-40853471-e3a4-4c91-862e-95dcf1e8c637" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] snapshot: 6f1602cf-0284-414a-8f3d-1cba91fac887, volume: 40853471-e3a4-4c91-862e-95dcf1e8c637, {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bf06262-6daf-465c-887f-f990869c133a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:46 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 Aug 09 12:48:46 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:46 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887" returned: 0 in 0.427s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e31629-cc8e-4b93-9914-3666c9223323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fe9b2c-aaaa-48c5-bfa6-d5fbc9004e3d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:47 devstack sudo[97600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 Aug 09 12:48:47 devstack sudo[97600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:47 devstack sudo[97600]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323" returned: 0 in 0.444s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 12:48:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Creating direct copy from snapshot {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 12:48:47 devstack cinder-volume[89309]: DEBUG cinder.utils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Path /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637 not found in is_blk_device check {{(pid=89309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 12:48:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:47 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637 Aug 09 12:48:47 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:53 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637" returned: 0 in 6.124s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:53 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:48:53 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Converted 1024.00 MB image at 167.18 MB/s Aug 09 12:48:53 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637 is being set with open permissions: ugo+rw Aug 09 12:48:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:53 devstack sudo[97626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637 Aug 09 12:48:53 devstack sudo[97626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:53 devstack sudo[97626]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637" returned: 0 in 0.336s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-40853471-e3a4-4c91-862e-95dcf1e8c637" released by "_copy_volume_from_snapshot" :: held 7.456s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-6f1602cf-0284-414a-8f3d-1cba91fac887-40853471-e3a4-4c91-862e-95dcf1e8c637" released by "_create_volume_from_snapshot" :: held 7.542s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.560s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99661312-9ed1-4ad9-a028-ccfa35035ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40853471-e3a4-4c91-862e-95dcf1e8c637', 'volume_size': 1, 'snapshot_id': '6f1602cf-0284-414a-8f3d-1cba91fac887'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fafab4a-4060-4a3e-aeba-186278949912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:54 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Volume volume-40853471-e3a4-4c91-862e-95dcf1e8c637 (40853471-e3a4-4c91-862e-95dcf1e8c637): created successfully Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2fafab4a-4060-4a3e-aeba-186278949912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Flow 'volume_create_manager' (31a917b9-771b-4a69-a578-e8b2743d981e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:54 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-fa97ee3d-ee30-4a67-9aa0-50c46318a454 tempest-VolumesDeleteCascade-1993538286 None] Created volume successfully. Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-b9e31629-cc8e-4b93-9914-3666c9223323-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-b9e31629-cc8e-4b93-9914-3666c9223323-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Performing cascade delete. {{(pid=89309) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-6f1602cf-0284-414a-8f3d-1cba91fac887-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-6f1602cf-0284-414a-8f3d-1cba91fac887-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-quobyte-b9e31629-cc8e-4b93-9914-3666c9223323" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-b9e31629-cc8e-4b93-9914-3666c9223323" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-quobyte-6f1602cf-0284-414a-8f3d-1cba91fac887" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-6f1602cf-0284-414a-8f3d-1cba91fac887" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Deleting offline snapshot 6f1602cf-0284-414a-8f3d-1cba91fac887 of volume b9e31629-cc8e-4b93-9914-3666c9223323 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] snapshot_file for this snap is: volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Flow 'volume_create_manager' (79e51538-9ec5-4ba7-ae21-aa3f49b5c286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c5d0c9-5b3d-4f20-9b18-1d3e2059479d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e255a658-3c57-43c8-b941-5813972a7851]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85c5d0c9-5b3d-4f20-9b18-1d3e2059479d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1884771780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e673a1-c747-408f-b94f-624e057108c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449b0c9106848fb82e1dbd136bfc0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:55Z,use_quota=True,user_id='e8b50efbedcb4af9bd4b07565bd6e969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd93959-5f8f-484e-95a9-52aa05d4d108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cd93959-5f8f-484e-95a9-52aa05d4d108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54da1147-07b4-4a65-ab87-7c98d48e3d3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54da1147-07b4-4a65-ab87-7c98d48e3d3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52e673a1-c747-408f-b94f-624e057108c3', 'volume_name': 'volume-52e673a1-c747-408f-b94f-624e057108c3', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e1bcd0-5b4f-4899-a08f-76e9afe7a1ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e1bcd0-5b4f-4899-a08f-76e9afe7a1ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5738e71-fae7-445b-85a2-c49a8497ea24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:54 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Volume 52e673a1-c747-408f-b94f-624e057108c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52e673a1-c747-408f-b94f-624e057108c3', 'volume_size': 1} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:48:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1884771780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52e673a1-c747-408f-b94f-624e057108c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449b0c9106848fb82e1dbd136bfc0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:48:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:48:55Z,use_quota=True,user_id='e8b50efbedcb4af9bd4b07565bd6e969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Creating volume 52e673a1-c747-408f-b94f-624e057108c3 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:48:54 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:48:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-52e673a1-c747-408f-b94f-624e057108c3 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:54 devstack sudo[97632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-52e673a1-c747-408f-b94f-624e057108c3 1073741824 Aug 09 12:48:54 devstack sudo[97632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:54 devstack sudo[97631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 Aug 09 12:48:54 devstack sudo[97631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:55 devstack sudo[97631]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887" returned: 0 in 0.489s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9e31629-cc8e-4b93-9914-3666c9223323(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:48:55 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b760d6-f2eb-4afb-9fed-30d0a7565941]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:55 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 Aug 09 12:48:55 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:55 devstack sudo[97632]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-52e673a1-c747-408f-b94f-624e057108c3 1073741824" returned: 0 in 0.661s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-52e673a1-c747-408f-b94f-624e057108c3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:55 devstack sudo[97645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-52e673a1-c747-408f-b94f-624e057108c3 Aug 09 12:48:55 devstack sudo[97645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:56 devstack sudo[97645]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-52e673a1-c747-408f-b94f-624e057108c3" returned: 0 in 0.424s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:48:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5738e71-fae7-445b-85a2-c49a8497ea24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52e673a1-c747-408f-b94f-624e057108c3', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d483e0-3bb9-4ce3-8b9c-5d77c3f2d988) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:48:56 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Volume volume-52e673a1-c747-408f-b94f-624e057108c3 (52e673a1-c747-408f-b94f-624e057108c3): created successfully Aug 09 12:48:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1d483e0-3bb9-4ce3-8b9c-5d77c3f2d988) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:48:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Flow 'volume_create_manager' (79e51538-9ec5-4ba7-ae21-aa3f49b5c286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:48:56 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1424e538-494a-4dca-a0c8-15fcd4e000fa tempest-AttachVolumeNegativeTest-1965921425 None] Created volume successfully. Aug 09 12:48:56 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323" returned: 0 in 0.863s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:56 devstack sudo[97653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 Aug 09 12:48:56 devstack sudo[97653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:56 devstack sudo[97653]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887" returned: 0 in 0.398s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:56 devstack sudo[97658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887 Aug 09 12:48:56 devstack sudo[97658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:56 devstack sudo[97658]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323.6f1602cf-0284-414a-8f3d-1cba91fac887" returned: 0 in 0.455s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-6f1602cf-0284-414a-8f3d-1cba91fac887" released by "_delete_snapshot" :: held 2.360s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-b9e31629-cc8e-4b93-9914-3666c9223323" released by "delete_snapshot" :: held 2.391s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Created reservations ['e67aa762-98f0-483f-8e28-4cbcf8826c3c', 'c587cf67-b84e-4deb-9537-74d7ec50a2a6', '98b335a7-9022-4675-865f-34fb797bb37e', '73630500-4064-4955-aee9-6050143a17c6'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:48:57 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Delete snapshot completed successfully. Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-6f1602cf-0284-414a-8f3d-1cba91fac887-delete_snapshot" released by "delete_snapshot" :: held 2.697s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Snapshots deleted, issuing volume delete {{(pid=89309) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-quobyte-b9e31629-cc8e-4b93-9914-3666c9223323" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-b9e31629-cc8e-4b93-9914-3666c9223323" acquired by "delete_volume" :: waited 0.012s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c49dde31-cdf7-438b-99fc-da6c2c7b90cd]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:57 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 Aug 09 12:48:57 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:57 devstack sudo[97676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:48:57 devstack sudo[97676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-d9dbb532-eedf-4b36-b4cd-753b42d7d8c5 req-b959f9f7-9d80-43dc-96e7-24c0282df625 tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-d9dbb532-eedf-4b36-b4cd-753b42d7d8c5 req-b959f9f7-9d80-43dc-96e7-24c0282df625 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-d9dbb532-eedf-4b36-b4cd-753b42d7d8c5 req-b959f9f7-9d80-43dc-96e7-24c0282df625 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.055s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-d9dbb532-eedf-4b36-b4cd-753b42d7d8c5 req-b959f9f7-9d80-43dc-96e7-24c0282df625 tempest-AttachVolumeNegativeTest-1965921425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-52e673a1-c747-408f-b94f-624e057108c3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '21fec26d-dfdf-4699-89ec-b03acd70f414', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:48:58 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323" returned: 0 in 0.646s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:58 devstack sudo[97676]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.421s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:58 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323 Aug 09 12:48:58 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:48:58 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-d9dbb532-eedf-4b36-b4cd-753b42d7d8c5 req-b959f9f7-9d80-43dc-96e7-24c0282df625 tempest-AttachVolumeNegativeTest-1965921425 None] attachment_update completed successfully. Aug 09 12:48:58 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b9e31629-cc8e-4b93-9914-3666c9223323" returned: 0 in 0.490s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-b9e31629-cc8e-4b93-9914-3666c9223323" released by "delete_volume" :: held 1.245s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Created reservations ['cb115be2-9c6e-4da2-b7ea-2f3e64f0513c', 'df7d06cf-03c4-4cb6-a52c-4e010c87efa5', '7e983490-a23e-4a68-aeea-f25957ef5a27', 'febf0a71-86f5-47c9-a405-01ffab1ec883'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:48:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:58 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:48:58 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-40853471-e3a4-4c91-862e-95dcf1e8c637-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:59 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.587s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:59 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:48:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-40853471-e3a4-4c91-862e-95dcf1e8c637-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:59 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Deleted volume successfully. Aug 09 12:48:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9b25ae20-9ac2-4f7b-ba87-df10ac182f9b tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-b9e31629-cc8e-4b93-9914-3666c9223323-delete_volume" released by "delete_volume" :: held 4.936s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:48:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "cinder-quobyte-40853471-e3a4-4c91-862e-95dcf1e8c637" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:48:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-40853471-e3a4-4c91-862e-95dcf1e8c637" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:48:59 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8401ab0-44f6-4e1e-94a2-5c27cd756c07]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:48:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:48:59 devstack sudo[98073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637 Aug 09 12:48:59 devstack sudo[98073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:48:59 devstack sudo[98073]: pam_unix(sudo:session): session closed for user root Aug 09 12:48:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637" returned: 0 in 0.469s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:48:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:00 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637 Aug 09 12:49:00 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:00 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-40853471-e3a4-4c91-862e-95dcf1e8c637" returned: 0 in 0.335s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-quobyte-40853471-e3a4-4c91-862e-95dcf1e8c637" released by "delete_volume" :: held 0.861s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:49:00 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Created reservations ['762eefbe-d3a0-4632-9fe7-f636db474008', 'e64c31da-e44d-47e0-bf36-dfd6210bbcac', '0c6e8d71-1fe7-4947-96e8-272081bafc02', '8735d5fd-9187-48e3-b0bb-2f11aaf0d6cf'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:49:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:49:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:49:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:00 devstack sudo[98089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:49:00 devstack sudo[98089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:00 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-2b805680-c3d8-4c85-8125-db903422cbe7 req-cffc98a0-9b6e-4032-9eba-57fee9ae2c66 tempest-AttachVolumeNegativeTest-1965921425 None] Terminate volume connection completed successfully. Aug 09 12:49:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-2b805680-c3d8-4c85-8125-db903422cbe7 req-cffc98a0-9b6e-4032-9eba-57fee9ae2c66 tempest-AttachVolumeNegativeTest-1965921425 None] Deleting attachment 21fec26d-dfdf-4699-89ec-b03acd70f414. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:49:00 devstack sudo[98089]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.419s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:01 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:49:01 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Deleted volume successfully. Aug 09 12:49:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-afe6a0e7-8cd8-42bd-a2bf-ce3eef731975 tempest-VolumesDeleteCascade-1993538286 None] Lock "cinder-40853471-e3a4-4c91-862e-95dcf1e8c637-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=112,cinder:UPDATE=115,cinder:INSERT=27,cinder:DELETE=11 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=122,cinder:INSERT=31,cinder:DELETE=9,cinder:SELECT=85 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Flow 'volume_create_manager' (f6992c85-a183-42ae-979a-73c2487f2e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7552189d-e588-4f17-bb8f-653a0a6de253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7552189d-e588-4f17-bb8f-653a0a6de253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1646523262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1ca9af-6812-466a-baa7-53fab441593a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2c92f44b0f49678bf553cfd56ac30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:49:10Z,use_quota=True,user_id='f7ee9cd04acf4eb6b869e3e114d18963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df609f48-1ea4-48c6-861e-c4c4e319846d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df609f48-1ea4-48c6-861e-c4c4e319846d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70be72a3-f51c-4717-b5b4-1618a9c44193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70be72a3-f51c-4717-b5b4-1618a9c44193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a1ca9af-6812-466a-baa7-53fab441593a', 'volume_name': 'volume-2a1ca9af-6812-466a-baa7-53fab441593a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7778e9-1045-492a-82aa-f037e9ac8573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de7778e9-1045-492a-82aa-f037e9ac8573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e61e789-a7a8-421d-a17b-2d80e3ff2b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:09 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Volume 2a1ca9af-6812-466a-baa7-53fab441593a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a1ca9af-6812-466a-baa7-53fab441593a', 'volume_size': 1} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1646523262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a1ca9af-6812-466a-baa7-53fab441593a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2c92f44b0f49678bf553cfd56ac30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:49:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:49:10Z,use_quota=True,user_id='f7ee9cd04acf4eb6b869e3e114d18963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Creating volume 2a1ca9af-6812-466a-baa7-53fab441593a {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:49:09 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:49:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2a1ca9af-6812-466a-baa7-53fab441593a 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:10 devstack sudo[98188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2a1ca9af-6812-466a-baa7-53fab441593a 1073741824 Aug 09 12:49:10 devstack sudo[98188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:10 devstack sudo[98188]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2a1ca9af-6812-466a-baa7-53fab441593a 1073741824" returned: 0 in 0.590s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2a1ca9af-6812-466a-baa7-53fab441593a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:10 devstack sudo[98194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2a1ca9af-6812-466a-baa7-53fab441593a Aug 09 12:49:10 devstack sudo[98194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:10 devstack sudo[98194]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2a1ca9af-6812-466a-baa7-53fab441593a" returned: 0 in 0.308s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] <== create_volume: return (963ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:49:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.966s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e61e789-a7a8-421d-a17b-2d80e3ff2b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a1ca9af-6812-466a-baa7-53fab441593a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1ce56a-0c53-419f-bbc1-535271fb1b4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:10 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Volume volume-2a1ca9af-6812-466a-baa7-53fab441593a (2a1ca9af-6812-466a-baa7-53fab441593a): created successfully Aug 09 12:49:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc1ce56a-0c53-419f-bbc1-535271fb1b4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Flow 'volume_create_manager' (f6992c85-a183-42ae-979a-73c2487f2e98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:49:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-9d793934-d983-47ff-8626-3b711032133c tempest-VolumesTransfersTest-912121110 None] Created volume successfully. Aug 09 12:49:13 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-caf9ba85-110c-4aa5-910d-ed28c902d0d6 tempest-VolumesTransfersTest-10983162 None] Transfer volume completed successfully. Aug 09 12:49:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Acquiring lock "cinder-2a1ca9af-6812-466a-baa7-53fab441593a-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:49:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Lock "cinder-2a1ca9af-6812-466a-baa7-53fab441593a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:49:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Acquiring lock "cinder-quobyte-2a1ca9af-6812-466a-baa7-53fab441593a" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:49:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Lock "cinder-quobyte-2a1ca9af-6812-466a-baa7-53fab441593a" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:49:14 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1be64374-d50b-4283-8686-7b511661b674]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:49:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2a1ca9af-6812-466a-baa7-53fab441593a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:14 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2a1ca9af-6812-466a-baa7-53fab441593a Aug 09 12:49:14 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:14 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2a1ca9af-6812-466a-baa7-53fab441593a" returned: 0 in 0.725s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2a1ca9af-6812-466a-baa7-53fab441593a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:14 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2a1ca9af-6812-466a-baa7-53fab441593a Aug 09 12:49:14 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:15 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2a1ca9af-6812-466a-baa7-53fab441593a" returned: 0 in 0.454s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Lock "cinder-quobyte-2a1ca9af-6812-466a-baa7-53fab441593a" released by "delete_volume" :: held 1.290s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:49:15 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Created reservations ['42beb18c-8f37-493e-86be-15f6ec2c4113', '69f4e0ee-3024-47c7-b401-9df5b135714a', '790ecddf-36f9-4fbb-a180-108bef40672e', '70fdfa29-0121-4b9b-856b-ef34fa1eb4bb'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:49:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:49:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:49:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:15 devstack sudo[98346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:49:15 devstack sudo[98346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:16 devstack sudo[98346]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.811s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:16 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:49:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Deleted volume successfully. Aug 09 12:49:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-83d9948e-a94b-483b-b2b6-098c59cabf7c tempest-VolumesTransfersTest-769113754 None] Lock "cinder-2a1ca9af-6812-466a-baa7-53fab441593a-delete_volume" released by "delete_volume" :: held 2.765s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:49:17 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:49:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Flow 'volume_create_manager' (5d2cd568-dd81-45ea-898b-159f108411bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:49:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995468e8-30ef-454c-976a-de87a99e4c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (995468e8-30ef-454c-976a-de87a99e4c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-179128153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51eddd7-5c39-460a-b05d-08eab9aa83b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2c92f44b0f49678bf553cfd56ac30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:49:18Z,use_quota=True,user_id='f7ee9cd04acf4eb6b869e3e114d18963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d32eb08-17f3-462a-80a2-f6dad4621221) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d32eb08-17f3-462a-80a2-f6dad4621221) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1039ac8-9a96-449f-9a51-79376a5aa894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1039ac8-9a96-449f-9a51-79376a5aa894) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f51eddd7-5c39-460a-b05d-08eab9aa83b4', 'volume_name': 'volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61684823-ecaf-4478-aff0-abe7ce2dc53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61684823-ecaf-4478-aff0-abe7ce2dc53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f0539d-0daf-48ab-a5d2-bdb7eb4e2577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:18 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Volume f51eddd7-5c39-460a-b05d-08eab9aa83b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4', 'volume_size': 1} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:49:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-179128153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51eddd7-5c39-460a-b05d-08eab9aa83b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef2c92f44b0f49678bf553cfd56ac30b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:49:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:49:18Z,use_quota=True,user_id='f7ee9cd04acf4eb6b869e3e114d18963',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Creating volume f51eddd7-5c39-460a-b05d-08eab9aa83b4 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:49:18 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:49:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:18 devstack sudo[98354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4 1073741824 Aug 09 12:49:18 devstack sudo[98354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:19 devstack sudo[98354]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4 1073741824" returned: 0 in 1.300s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:19 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4 Aug 09 12:49:19 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:20 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4" returned: 0 in 0.551s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] <== create_volume: return (1952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:49:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.971s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0f0539d-0daf-48ab-a5d2-bdb7eb4e2577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91fd84ff-cd0d-47ce-9ab7-24160b588ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:20 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Volume volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4 (f51eddd7-5c39-460a-b05d-08eab9aa83b4): created successfully Aug 09 12:49:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91fd84ff-cd0d-47ce-9ab7-24160b588ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Flow 'volume_create_manager' (5d2cd568-dd81-45ea-898b-159f108411bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:49:20 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8ce853c0-3ca7-4ec2-bc51-6987296cb3f5 tempest-VolumesTransfersTest-912121110 None] Created volume successfully. Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Flow 'volume_create_manager' (7419de63-0937-4784-809e-5adf37729131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7f586c-74a3-451b-b463-7c60192317cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7f586c-74a3-451b-b463-7c60192317cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1909706766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f915fa4a-25bb-4a27-a2d7-c9302b4543ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c5d6cd9b4624e0c8db7a22798b1557b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:49:21Z,use_quota=True,user_id='8329c7d4fd204bf5af069677322e4108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4336e07a-83be-4b15-831f-c1e38cb1ec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4336e07a-83be-4b15-831f-c1e38cb1ec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7422bf-dfcd-4efb-bcd8-bf3e5c1bc500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e7422bf-dfcd-4efb-bcd8-bf3e5c1bc500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f915fa4a-25bb-4a27-a2d7-c9302b4543ad', 'volume_name': 'volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9274fa83-7994-40ae-9a30-11e913b9b12f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9274fa83-7994-40ae-9a30-11e913b9b12f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea1df22-d49c-45c5-887c-02916e9abf43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:21 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Volume f915fa4a-25bb-4a27-a2d7-c9302b4543ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad', 'volume_size': 1} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:49:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1909706766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f915fa4a-25bb-4a27-a2d7-c9302b4543ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4c5d6cd9b4624e0c8db7a22798b1557b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:49:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:49:21Z,use_quota=True,user_id='8329c7d4fd204bf5af069677322e4108',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Creating volume f915fa4a-25bb-4a27-a2d7-c9302b4543ad {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:49:21 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:49:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:21 devstack sudo[98368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad 1073741824 Aug 09 12:49:21 devstack sudo[98368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Acquiring lock "cinder-f51eddd7-5c39-460a-b05d-08eab9aa83b4-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:49:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Lock "cinder-f51eddd7-5c39-460a-b05d-08eab9aa83b4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:49:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Acquiring lock "cinder-quobyte-f51eddd7-5c39-460a-b05d-08eab9aa83b4" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:49:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Lock "cinder-quobyte-f51eddd7-5c39-460a-b05d-08eab9aa83b4" acquired by "delete_volume" :: waited 0.045s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:49:22 devstack sudo[98368]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad 1073741824" returned: 0 in 0.968s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:22 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1d8c37c-afe6-474e-b202-dfeaff7c7e78]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:49:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:22 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad Aug 09 12:49:22 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:22 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4 Aug 09 12:49:22 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:22 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" returned: 0 in 0.552s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] <== create_volume: return (1650ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:49:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ea1df22-d49c-45c5-887c-02916e9abf43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f998d5d-364a-4556-9a65-cd1e6804a306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:23 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Volume volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad (f915fa4a-25bb-4a27-a2d7-c9302b4543ad): created successfully Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f998d5d-364a-4556-9a65-cd1e6804a306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Flow 'volume_create_manager' (7419de63-0937-4784-809e-5adf37729131) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:49:23 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4" returned: 0 in 0.816s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:23 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c3edaf5f-6275-4235-9e0f-5fa12c5fe88f tempest-VolumesActionsTest-1743855873 None] Created volume successfully. Aug 09 12:49:23 devstack sudo[98405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4 Aug 09 12:49:23 devstack sudo[98405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:23 devstack sudo[98405]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f51eddd7-5c39-460a-b05d-08eab9aa83b4" returned: 0 in 0.538s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Lock "cinder-quobyte-f51eddd7-5c39-460a-b05d-08eab9aa83b4" released by "delete_volume" :: held 1.463s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Created reservations ['30b2f95e-bb05-4861-bb6f-ca1af8a9ef70', '195f8b04-c625-4df2-8b98-b69f0d0b583c', '11afe2fe-ac12-4d9a-af35-629efae2e857', 'e555caf5-1c6a-42b5-a27c-4df9758883f8'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:24 devstack sudo[98420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:49:24 devstack sudo[98420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:24 devstack sudo[98420]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.368s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:24 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:49:24 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Deleted volume successfully. Aug 09 12:49:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8e3260f-2c94-4202-a48b-604eb19bf427 tempest-VolumesTransfersTest-769113754 None] Lock "cinder-f51eddd7-5c39-460a-b05d-08eab9aa83b4-delete_volume" released by "delete_volume" :: held 2.303s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Flow 'volume_create_manager' (bd6a68be-4641-4098-b7ae-c9077b86df74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a931d3-b6b4-4795-9832-5683e281ac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73a931d3-b6b4-4795-9832-5683e281ac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1053070964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e32887-e5a6-4c75-80fd-cf33fbb67c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ef2b1f7b584cc0be5cf23fb6141308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:49:31Z,use_quota=True,user_id='a05d88c9d273496083ec3548646635a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f47d7a-b202-4bd0-948c-821298c9bdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8f47d7a-b202-4bd0-948c-821298c9bdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bec9a6-d53f-47d5-8af3-f98c2ac76992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39bec9a6-d53f-47d5-8af3-f98c2ac76992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e32887-e5a6-4c75-80fd-cf33fbb67c5b', 'volume_name': 'volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a0edf7-017e-4f65-8038-86920879374e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a0edf7-017e-4f65-8038-86920879374e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2913f7-96a6-4bcb-865e-9041c2de881f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:31 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Volume 97e32887-e5a6-4c75-80fd-cf33fbb67c5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b', 'volume_size': 1} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1053070964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e32887-e5a6-4c75-80fd-cf33fbb67c5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4ef2b1f7b584cc0be5cf23fb6141308',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:49:31Z,use_quota=True,user_id='a05d88c9d273496083ec3548646635a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Creating volume 97e32887-e5a6-4c75-80fd-cf33fbb67c5b {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:49:31 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:49:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:31 devstack sudo[98598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b 1073741824 Aug 09 12:49:31 devstack sudo[98598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:32 devstack sudo[98598]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b 1073741824" returned: 0 in 1.251s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:32 devstack sudo[98624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b Aug 09 12:49:32 devstack sudo[98624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:33 devstack sudo[98624]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b" returned: 0 in 0.645s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] <== create_volume: return (2002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:49:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e2913f7-96a6-4bcb-865e-9041c2de881f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d7d139-4d66-441b-972f-65e089d98216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:33 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Volume volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b (97e32887-e5a6-4c75-80fd-cf33fbb67c5b): created successfully Aug 09 12:49:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85d7d139-4d66-441b-972f-65e089d98216) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Flow 'volume_create_manager' (bd6a68be-4641-4098-b7ae-c9077b86df74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:49:33 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4421a8e9-20a7-46d6-938a-a850c049c58b tempest-ServerRescueNegativeTestJSON-1964445243 None] Created volume successfully. Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Flow 'volume_create_manager' (765e0613-035d-4671-be7d-88de51e59458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b144958-06b8-42c9-8242-e8b9ce10c053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b144958-06b8-42c9-8242-e8b9ce10c053) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-473411644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff777aa-4f7b-4307-bc3d-8138ebe5122f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531e71033571448784cf2d56e3279939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:49:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:49:42Z,use_quota=True,user_id='5cd136d5c002428ca621097dd35698ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba7bb66-ed75-4d82-943b-b071a5139211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ba7bb66-ed75-4d82-943b-b071a5139211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e941456-b87d-4606-802d-9bebdacbaefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e941456-b87d-4606-802d-9bebdacbaefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aff777aa-4f7b-4307-bc3d-8138ebe5122f', 'volume_name': 'volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f', 'volume_size': 2}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172de513-0ccb-4d61-ac60-abb1ac5a3678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (172de513-0ccb-4d61-ac60-abb1ac5a3678) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5d7d9b-1d4e-4f78-866a-d2478bf21939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:42 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Volume aff777aa-4f7b-4307-bc3d-8138ebe5122f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f', 'volume_size': 2} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:49:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-473411644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aff777aa-4f7b-4307-bc3d-8138ebe5122f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='531e71033571448784cf2d56e3279939',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:49:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:49:42Z,use_quota=True,user_id='5cd136d5c002428ca621097dd35698ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Creating volume aff777aa-4f7b-4307-bc3d-8138ebe5122f {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:49:42 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:49:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f 2147483648 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:42 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f 2147483648 Aug 09 12:49:42 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:43 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f 2147483648" returned: 0 in 1.078s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:43 devstack sudo[98838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f Aug 09 12:49:43 devstack sudo[98838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:44 devstack sudo[98838]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f" returned: 0 in 0.761s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:49:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.979s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc5d7d9b-1d4e-4f78-866a-d2478bf21939) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f', 'volume_size': 2}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5105ccd-c962-4553-9af4-3e77f6e11351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:49:44 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Volume volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f (aff777aa-4f7b-4307-bc3d-8138ebe5122f): created successfully Aug 09 12:49:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5105ccd-c962-4553-9af4-3e77f6e11351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:49:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Flow 'volume_create_manager' (765e0613-035d-4671-be7d-88de51e59458) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:49:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-df40ab26-e3f0-4c59-a892-a904f8ecba39 tempest-VolumesCloneNegativeTest-675088609 None] Created volume successfully. Aug 09 12:49:45 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Acquiring lock "cinder-aff777aa-4f7b-4307-bc3d-8138ebe5122f-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:49:45 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Lock "cinder-aff777aa-4f7b-4307-bc3d-8138ebe5122f-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:49:45 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Acquiring lock "cinder-quobyte-aff777aa-4f7b-4307-bc3d-8138ebe5122f" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:49:45 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Lock "cinder-quobyte-aff777aa-4f7b-4307-bc3d-8138ebe5122f" acquired by "delete_volume" :: waited 0.037s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:49:45 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e649707-fb86-49c9-b089-0fbe26a5c171]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:49:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:46 devstack sudo[98860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f Aug 09 12:49:46 devstack sudo[98860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a96547f1-67e4-4543-aa15-820c0ada85fb tempest-VolumesActionsTest-1743855873 None] Acquiring lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" by "attach_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:49:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a96547f1-67e4-4543-aa15-820c0ada85fb tempest-VolumesActionsTest-1743855873 None] Lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" acquired by "attach_volume" :: waited 0.038s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:49:46 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a96547f1-67e4-4543-aa15-820c0ada85fb tempest-VolumesActionsTest-1743855873 None] Attaching volume f915fa4a-25bb-4a27-a2d7-c9302b4543ad to instance 87f28b31-2cac-47cb-a39e-069c4843d11c at mountpoint /dev/vdb on host None. Aug 09 12:49:46 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a96547f1-67e4-4543-aa15-820c0ada85fb tempest-VolumesActionsTest-1743855873 None] Attach volume completed successfully. Aug 09 12:49:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a96547f1-67e4-4543-aa15-820c0ada85fb tempest-VolumesActionsTest-1743855873 None] Lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" released by "attach_volume" :: held 0.181s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:49:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-84545d89-8611-4fe6-ad84-307f4ceba2ed tempest-VolumesActionsTest-1743855873 None] Acquiring lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad-detach_volume" by "detach_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:49:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-84545d89-8611-4fe6-ad84-307f4ceba2ed tempest-VolumesActionsTest-1743855873 None] Lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad-detach_volume" acquired by "detach_volume" :: waited 0.039s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:49:46 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-84545d89-8611-4fe6-ad84-307f4ceba2ed tempest-VolumesActionsTest-1743855873 None] Detaching volume f915fa4a-25bb-4a27-a2d7-c9302b4543ad from instance 87f28b31-2cac-47cb-a39e-069c4843d11c. Aug 09 12:49:46 devstack sudo[98860]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f" returned: 0 in 0.711s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:46 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f Aug 09 12:49:46 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:46 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-84545d89-8611-4fe6-ad84-307f4ceba2ed tempest-VolumesActionsTest-1743855873 None] Detach volume completed successfully. Aug 09 12:49:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-84545d89-8611-4fe6-ad84-307f4ceba2ed tempest-VolumesActionsTest-1743855873 None] Lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad-detach_volume" released by "detach_volume" :: held 0.175s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:49:47 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aff777aa-4f7b-4307-bc3d-8138ebe5122f" returned: 0 in 0.582s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Lock "cinder-quobyte-aff777aa-4f7b-4307-bc3d-8138ebe5122f" released by "delete_volume" :: held 1.382s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:49:47 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Created reservations ['fc5f500d-e1fc-4b9f-953b-ea4fdec01348', '3d62a090-b9d1-4a70-a973-08a35a69b181', 'ecfe5cf2-7b3b-43a5-8c79-c009884cbb79', '80ff69d4-7c34-4caf-bd46-8acaa01762fa'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:49:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:49:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:49:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:47 devstack sudo[98899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:49:47 devstack sudo[98899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:48 devstack sudo[98899]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.744s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:48 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:49:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Deleted volume successfully. Aug 09 12:49:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c97b5207-38a7-4e1f-bdd7-dab06f68b1a7 tempest-VolumesCloneNegativeTest-675088609 None] Lock "cinder-aff777aa-4f7b-4307-bc3d-8138ebe5122f-delete_volume" released by "delete_volume" :: held 2.670s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:49:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Acquiring lock "cinder-97e32887-e5a6-4c75-80fd-cf33fbb67c5b-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:49:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Lock "cinder-97e32887-e5a6-4c75-80fd-cf33fbb67c5b-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:49:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Acquiring lock "cinder-quobyte-97e32887-e5a6-4c75-80fd-cf33fbb67c5b" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:49:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Lock "cinder-quobyte-97e32887-e5a6-4c75-80fd-cf33fbb67c5b" acquired by "delete_volume" :: waited 0.035s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:49:52 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dbfc467-49ef-4672-a335-4537fb84d410]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:49:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:53 devstack sudo[98984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b Aug 09 12:49:53 devstack sudo[98984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:53 devstack sudo[98984]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b" returned: 0 in 0.584s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:53 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b Aug 09 12:49:53 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:53 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-97e32887-e5a6-4c75-80fd-cf33fbb67c5b" returned: 0 in 0.455s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Lock "cinder-quobyte-97e32887-e5a6-4c75-80fd-cf33fbb67c5b" released by "delete_volume" :: held 1.130s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:49:54 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Created reservations ['747916d9-8929-4583-b06b-1c9af2587824', '3569cf7c-dd95-40fa-8620-9cef1c752b14', 'f66210e6-51de-4516-9952-0276296fe402', 'd00f15f9-8fff-4fc0-aebe-805a0aa2f1a5'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:49:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:49:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:49:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:54 devstack sudo[98992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:49:54 devstack sudo[98992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:54 devstack sudo[98992]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.705s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:54 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:49:54 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Deleted volume successfully. Aug 09 12:49:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0927d8bf-1b77-471e-9e5f-3f3b6a698b48 tempest-ServerRescueNegativeTestJSON-1964445243 None] Lock "cinder-97e32887-e5a6-4c75-80fd-cf33fbb67c5b-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:49:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:49:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:49:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:49:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:49:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:49:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:49:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:49:57 devstack sudo[99040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:49:57 devstack sudo[99040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:49:58 devstack sudo[99040]: pam_unix(sudo:session): session closed for user root Aug 09 12:49:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.648s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:49:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:49:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:49:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:49:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Flow 'volume_create_manager' (e8bd0d44-4b57-48c7-8c6b-3bd7fc2c784a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4879f11d-ab22-4667-b25e-c23693807a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4879f11d-ab22-4667-b25e-c23693807a61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1589998357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df22797-24ad-4631-8cd4-9f5e08533f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449b0c9106848fb82e1dbd136bfc0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:50:02Z,use_quota=True,user_id='e8b50efbedcb4af9bd4b07565bd6e969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3804b0dc-994d-4852-9a6b-aafeb8592485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3804b0dc-994d-4852-9a6b-aafeb8592485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc4a459-ba69-4880-96f1-d0f8d4e40dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc4a459-ba69-4880-96f1-d0f8d4e40dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1df22797-24ad-4631-8cd4-9f5e08533f50', 'volume_name': 'volume-1df22797-24ad-4631-8cd4-9f5e08533f50', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba157a1d-eb01-47a7-a5a2-4d8fb92dc58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba157a1d-eb01-47a7-a5a2-4d8fb92dc58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de3f77d-24a0-4a3e-a9fa-7d5f2eba21e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:02 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Volume 1df22797-24ad-4631-8cd4-9f5e08533f50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1df22797-24ad-4631-8cd4-9f5e08533f50', 'volume_size': 1} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:50:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1589998357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1df22797-24ad-4631-8cd4-9f5e08533f50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a449b0c9106848fb82e1dbd136bfc0d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:50:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:50:02Z,use_quota=True,user_id='e8b50efbedcb4af9bd4b07565bd6e969',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Creating volume 1df22797-24ad-4631-8cd4-9f5e08533f50 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:50:02 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:50:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1df22797-24ad-4631-8cd4-9f5e08533f50 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:02 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1df22797-24ad-4631-8cd4-9f5e08533f50 1073741824 Aug 09 12:50:02 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:03 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1df22797-24ad-4631-8cd4-9f5e08533f50 1073741824" returned: 0 in 1.005s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1df22797-24ad-4631-8cd4-9f5e08533f50 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:03 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1df22797-24ad-4631-8cd4-9f5e08533f50 Aug 09 12:50:03 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:03 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1df22797-24ad-4631-8cd4-9f5e08533f50" returned: 0 in 0.424s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] <== create_volume: return (1506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:50:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4de3f77d-24a0-4a3e-a9fa-7d5f2eba21e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1df22797-24ad-4631-8cd4-9f5e08533f50', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c283e383-8419-4fcd-9c34-e60a481e68c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:04 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Volume volume-1df22797-24ad-4631-8cd4-9f5e08533f50 (1df22797-24ad-4631-8cd4-9f5e08533f50): created successfully Aug 09 12:50:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c283e383-8419-4fcd-9c34-e60a481e68c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Flow 'volume_create_manager' (e8bd0d44-4b57-48c7-8c6b-3bd7fc2c784a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:50:04 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-9d6f09e5-8dce-41c2-a222-2ba8e7f0dd90 tempest-AttachVolumeNegativeTest-1965921425 None] Created volume successfully. Aug 09 12:50:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ca69d2ae-d6e0-4c19-97aa-63398f6c3ecb tempest-VolumesActionsTest-1743855873 None] Acquiring lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" by "attach_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:50:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ca69d2ae-d6e0-4c19-97aa-63398f6c3ecb tempest-VolumesActionsTest-1743855873 None] Lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" acquired by "attach_volume" :: waited 0.036s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:50:04 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ca69d2ae-d6e0-4c19-97aa-63398f6c3ecb tempest-VolumesActionsTest-1743855873 None] Attaching volume f915fa4a-25bb-4a27-a2d7-c9302b4543ad to instance 72fecb23-2b9c-483b-9380-24dc0d283a20 at mountpoint /dev/vdb on host None. Aug 09 12:50:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ca69d2ae-d6e0-4c19-97aa-63398f6c3ecb tempest-VolumesActionsTest-1743855873 None] Attach volume completed successfully. Aug 09 12:50:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ca69d2ae-d6e0-4c19-97aa-63398f6c3ecb tempest-VolumesActionsTest-1743855873 None] Lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" released by "attach_volume" :: held 0.206s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:50:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e788824b-a051-43ac-92b0-010416b7a2bd tempest-VolumesActionsTest-1743855873 None] Acquiring lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad-detach_volume" by "detach_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:50:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e788824b-a051-43ac-92b0-010416b7a2bd tempest-VolumesActionsTest-1743855873 None] Lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:50:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e788824b-a051-43ac-92b0-010416b7a2bd tempest-VolumesActionsTest-1743855873 None] Detaching volume f915fa4a-25bb-4a27-a2d7-c9302b4543ad from instance 72fecb23-2b9c-483b-9380-24dc0d283a20. Aug 09 12:50:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e788824b-a051-43ac-92b0-010416b7a2bd tempest-VolumesActionsTest-1743855873 None] Detach volume completed successfully. Aug 09 12:50:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e788824b-a051-43ac-92b0-010416b7a2bd tempest-VolumesActionsTest-1743855873 None] Lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad-detach_volume" released by "detach_volume" :: held 0.112s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:50:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-5d6e4192-b8cd-4597-a9db-79c4ee383574 req-b90df82c-8d49-4cea-b207-c1a221134e71 tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-5d6e4192-b8cd-4597-a9db-79c4ee383574 req-b90df82c-8d49-4cea-b207-c1a221134e71 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-5d6e4192-b8cd-4597-a9db-79c4ee383574 req-b90df82c-8d49-4cea-b207-c1a221134e71 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-5d6e4192-b8cd-4597-a9db-79c4ee383574 req-b90df82c-8d49-4cea-b207-c1a221134e71 tempest-AttachVolumeNegativeTest-1965921425 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-1df22797-24ad-4631-8cd4-9f5e08533f50', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f22bbb0-85ed-424a-bd34-da33ca9dde91', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:50:06 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-5d6e4192-b8cd-4597-a9db-79c4ee383574 req-b90df82c-8d49-4cea-b207-c1a221134e71 tempest-AttachVolumeNegativeTest-1965921425 None] attachment_update completed successfully. Aug 09 12:50:08 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-474937fb-9c3f-4a20-b5f0-6b6718b22e61 req-c6ce6dc7-b888-497b-a8e8-bc511c26f411 tempest-AttachVolumeNegativeTest-1965921425 None] Terminate volume connection completed successfully. Aug 09 12:50:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-474937fb-9c3f-4a20-b5f0-6b6718b22e61 req-c6ce6dc7-b888-497b-a8e8-bc511c26f411 tempest-AttachVolumeNegativeTest-1965921425 None] Deleting attachment 4f22bbb0-85ed-424a-bd34-da33ca9dde91. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=48,cinder:UPDATE=56,cinder:INSERT=10,cinder:DELETE=4 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=59,cinder:INSERT=16,cinder:UPDATE=60,cinder:DELETE=6 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Flow 'volume_create_manager' (f7b97801-15b3-4d93-b695-de311bed001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148959b9-3ecc-4383-a160-dd1a3dcc741e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (148959b9-3ecc-4383-a160-dd1a3dcc741e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1522146109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ecddf2-0573-4f11-93e9-8e8f0988b7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f2e11cdf554d17ae5da880ae3b8efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:50:13Z,use_quota=True,user_id='e57a8fa6bd25481596ad73677a5ef89d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f862899d-6b10-440d-8503-58c0dde1952c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f862899d-6b10-440d-8503-58c0dde1952c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ceed9f-6311-4f21-bfa1-30b577da4b4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12ceed9f-6311-4f21-bfa1-30b577da4b4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6ecddf2-0573-4f11-93e9-8e8f0988b7d4', 'volume_name': 'volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578fa1c6-5351-419d-a7e3-4e1bcfb6cf1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (578fa1c6-5351-419d-a7e3-4e1bcfb6cf1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235bafb3-3c87-42ae-a9f9-1b37f0aa4363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:13 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Volume b6ecddf2-0573-4f11-93e9-8e8f0988b7d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4', 'volume_size': 1} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:50:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1522146109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6ecddf2-0573-4f11-93e9-8e8f0988b7d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f2e11cdf554d17ae5da880ae3b8efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:50:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:50:13Z,use_quota=True,user_id='e57a8fa6bd25481596ad73677a5ef89d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Creating volume b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:50:13 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:13 devstack sudo[99645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 1073741824 Aug 09 12:50:13 devstack sudo[99645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:13 devstack sudo[99645]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 1073741824" returned: 0 in 0.563s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:13 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 Aug 09 12:50:13 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:14 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4" returned: 0 in 0.459s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:50:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235bafb3-3c87-42ae-a9f9-1b37f0aa4363) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5a8e73-be26-42ca-9e46-3c1a91bc3b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:14 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Volume volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 (b6ecddf2-0573-4f11-93e9-8e8f0988b7d4): created successfully Aug 09 12:50:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a5a8e73-be26-42ca-9e46-3c1a91bc3b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Flow 'volume_create_manager' (f7b97801-15b3-4d93-b695-de311bed001e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:50:14 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f8323ce9-5ceb-4232-9535-cf6d05056441 tempest-VolumesSnapshotTestJSON-1187682763 None] Created volume successfully. Aug 09 12:50:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] Creating offline snapshot f741fd77-5ea8-4a77-ab46-92058f282dbc of volume b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:50:15 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[68bc3311-b477-4e6a-b3ae-472915fd200b]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:15 devstack sudo[99659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 Aug 09 12:50:15 devstack sudo[99659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:16 devstack sudo[99659]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4" returned: 0 in 0.550s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:16 devstack sudo[99664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc 1G Aug 09 12:50:16 devstack sudo[99664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:16 devstack sudo[99664]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc 1G" returned: 0 in 0.547s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:16 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc Aug 09 12:50:16 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "cinder-1df22797-24ad-4631-8cd4-9f5e08533f50-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:50:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "cinder-1df22797-24ad-4631-8cd4-9f5e08533f50-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:50:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "cinder-quobyte-1df22797-24ad-4631-8cd4-9f5e08533f50" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:50:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "cinder-quobyte-1df22797-24ad-4631-8cd4-9f5e08533f50" acquired by "delete_volume" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:50:16 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69b697c-dcad-4843-8a0a-f344f668b0ee]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1df22797-24ad-4631-8cd4-9f5e08533f50 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:17 devstack sudo[99672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1df22797-24ad-4631-8cd4-9f5e08533f50 Aug 09 12:50:17 devstack sudo[99672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:17 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc" returned: 0 in 0.416s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:17 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc is being set with open permissions: ugo+rw Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:17 devstack sudo[99677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc Aug 09 12:50:17 devstack sudo[99677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:17 devstack sudo[99677]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc" returned: 0 in 0.267s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:17 devstack sudo[99672]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1df22797-24ad-4631-8cd4-9f5e08533f50" returned: 0 in 0.453s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1df22797-24ad-4631-8cd4-9f5e08533f50 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:17 devstack sudo[99684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1df22797-24ad-4631-8cd4-9f5e08533f50 Aug 09 12:50:17 devstack sudo[99684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:17 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.info Aug 09 12:50:17 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:17 devstack sudo[99684]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1df22797-24ad-4631-8cd4-9f5e08533f50" returned: 0 in 0.283s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:17 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "cinder-quobyte-1df22797-24ad-4631-8cd4-9f5e08533f50" released by "delete_volume" :: held 0.790s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.info" returned: 0 in 0.286s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:17 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.info is being set with open permissions: ugo+rw Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:17 devstack sudo[99690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.info Aug 09 12:50:17 devstack sudo[99690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Created reservations ['8af3c84a-7521-4dd6-9cc5-82026ae2f396', '14f21582-1913-4fef-b28d-417d8b479152', '208e8546-4bb0-4936-935e-f3e72e78ac1d', '98ec4a4a-476f-4cae-8650-2d9fb6adb5ff'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:17 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:50:17 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:17 devstack sudo[99690]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.info" returned: 0 in 0.289s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.946s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2556ebec-f9db-459e-8ca2-1276e6c769a8]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:18 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b1200a6c-30d8-4a1d-912a-86e7ab535092 tempest-VolumesSnapshotTestJSON-1187682763 None] Create snapshot completed successfully Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "cinder-52e673a1-c747-408f-b94f-624e057108c3-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "cinder-52e673a1-c747-408f-b94f-624e057108c3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:50:18 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.349s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:50:18 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Deleted volume successfully. Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "cinder-quobyte-52e673a1-c747-408f-b94f-624e057108c3" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "cinder-quobyte-52e673a1-c747-408f-b94f-624e057108c3" acquired by "delete_volume" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-50dc568e-b71d-4888-95ee-e217fada6ad0 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "cinder-1df22797-24ad-4631-8cd4-9f5e08533f50-delete_volume" released by "delete_volume" :: held 1.433s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c634e30-4a4f-42f7-a1f6-a97af716a394]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-52e673a1-c747-408f-b94f-624e057108c3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:18 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad Aug 09 12:50:18 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:18 devstack sudo[99698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-52e673a1-c747-408f-b94f-624e057108c3 Aug 09 12:50:18 devstack sudo[99698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:18 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" returned: 0 in 0.507s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d5d81c-311e-4f37-a30f-8290be256225]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:18 devstack sudo[99698]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-52e673a1-c747-408f-b94f-624e057108c3" returned: 0 in 0.458s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-52e673a1-c747-408f-b94f-624e057108c3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:18 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad Aug 09 12:50:18 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:18 devstack sudo[99709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-52e673a1-c747-408f-b94f-624e057108c3 Aug 09 12:50:18 devstack sudo[99709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-f741fd77-5ea8-4a77-ab46-92058f282dbc-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:50:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-f741fd77-5ea8-4a77-ab46-92058f282dbc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-f741fd77-5ea8-4a77-ab46-92058f282dbc" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-f741fd77-5ea8-4a77-ab46-92058f282dbc" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Deleting offline snapshot f741fd77-5ea8-4a77-ab46-92058f282dbc of volume b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:50:19 devstack sudo[99709]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] snapshot_file for this snap is: volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-52e673a1-c747-408f-b94f-624e057108c3" returned: 0 in 0.349s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[853fce8a-1eca-4977-bd18-849d870f91f4]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:19 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "cinder-quobyte-52e673a1-c747-408f-b94f-624e057108c3" released by "delete_volume" :: held 0.865s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" returned: 0 in 0.520s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.012fd716-8cc1-4d61-9d54-23a2edc9cdd34k8wzdj6.img {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:19 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.012fd716-8cc1-4d61-9d54-23a2edc9cdd34k8wzdj6.img Aug 09 12:50:19 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Created reservations ['3200fd4f-3697-42ee-bd59-3482c872a6d7', '7ff09a55-83bd-4a76-bc74-ff4ca45a17d3', '05ec4925-fa34-452d-b1a7-4ade9245f9f6', 'f8d14852-9a8c-4f0a-baf6-78900efb8c8e'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:50:19 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc Aug 09 12:50:19 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:19 devstack sudo[99719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:50:19 devstack sudo[99719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:19 devstack sudo[99719]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.404s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "cinder-91cff1c3-d9ac-4f38-9c12-77aa331f170b-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:50:19 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Deleted volume successfully. Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Lock "cinder-91cff1c3-d9ac-4f38-9c12-77aa331f170b-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-067c4dc1-490b-4c49-b9ca-8656c46105a2 tempest-AttachVolumeNegativeTest-1965921425 None] Lock "cinder-52e673a1-c747-408f-b94f-624e057108c3-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "cinder-quobyte-91cff1c3-d9ac-4f38-9c12-77aa331f170b" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:50:19 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc" returned: 0 in 0.822s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:50:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Lock "cinder-quobyte-91cff1c3-d9ac-4f38-9c12-77aa331f170b" acquired by "delete_volume" :: waited 0.106s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:50:20 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cedcad2-dcdd-4ce1-a286-36ced6341bf1]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:20 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a576d5a-c33c-485d-a441-3ed0a7e9d080]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:20 devstack sudo[99737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b Aug 09 12:50:20 devstack sudo[99737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:20 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 Aug 09 12:50:20 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:21 devstack sudo[99737]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b" returned: 0 in 0.895s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:21 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:21 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b Aug 09 12:50:21 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4" returned: 0 in 1.066s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:21 devstack sudo[99748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc Aug 09 12:50:21 devstack sudo[99748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:21 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-91cff1c3-d9ac-4f38-9c12-77aa331f170b" returned: 0 in 0.807s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Lock "cinder-quobyte-91cff1c3-d9ac-4f38-9c12-77aa331f170b" released by "delete_volume" :: held 1.875s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:50:21 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Created reservations ['107e35b0-4cde-4131-b2fb-f67f1eb68c8f', '5d3039d7-1cf0-446c-b214-246fd14fd58a', '98575deb-f850-422a-933a-2c76a2243ff0', 'a21e90ce-217c-4ebe-b839-35ddfac98d7f'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:50:22 devstack sudo[99748]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc" returned: 0 in 1.001s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:22 devstack sudo[99756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc Aug 09 12:50:22 devstack sudo[99756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:50:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:50:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:22 devstack sudo[99758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:50:22 devstack sudo[99758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:22 devstack sudo[99756]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4.f741fd77-5ea8-4a77-ab46-92058f282dbc" returned: 0 in 0.823s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-f741fd77-5ea8-4a77-ab46-92058f282dbc" released by "_delete_snapshot" :: held 4.103s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:50:23 devstack sudo[99758]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.879s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:23 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:50:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4" released by "delete_snapshot" :: held 4.162s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:50:23 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Deleted volume successfully. Aug 09 12:50:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d569dfb9-e489-4cf8-b2d4-729e2fb7861d tempest-AttachVolumeNegativeTest-1965921425 None] Lock "cinder-91cff1c3-d9ac-4f38-9c12-77aa331f170b-delete_volume" released by "delete_volume" :: held 3.528s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:50:23 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Created reservations ['d67834de-4d66-4de5-a89d-700b8bdf9a39', 'cdd414ea-501e-4ccc-8adc-65bd44bf89fc', '4e153730-4d71-49d4-8682-3fe634f58db4', 'fd2c3af3-fe37-4932-921e-e2e279cf393b'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:50:23 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Delete snapshot completed successfully. Aug 09 12:50:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ba20ab19-f2e5-44ab-9511-8c590675e350 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-f741fd77-5ea8-4a77-ab46-92058f282dbc-delete_snapshot" released by "delete_snapshot" :: held 4.696s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:50:25 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.012fd716-8cc1-4d61-9d54-23a2edc9cdd34k8wzdj6.img" returned: 0 in 6.127s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17a1299-f052-4bda-ae8e-e362ae6e29ff]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:25 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad Aug 09 12:50:25 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Flow 'volume_create_manager' (44c67c24-de39-44b4-a6bb-173e3fc15efb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d456686-3df0-4227-b037-c4487795fe23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d456686-3df0-4227-b037-c4487795fe23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1452607124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04018c9-a87b-4473-8b5e-92ca22f7a619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f2e11cdf554d17ae5da880ae3b8efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:50:26Z,use_quota=True,user_id='e57a8fa6bd25481596ad73677a5ef89d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d32bbb7-2fe4-4b0e-aad8-e5ed6237bbdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d32bbb7-2fe4-4b0e-aad8-e5ed6237bbdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87c6aaf-a550-4be3-a4e3-a6739cdb9a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c87c6aaf-a550-4be3-a4e3-a6739cdb9a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e04018c9-a87b-4473-8b5e-92ca22f7a619', 'volume_name': 'volume-e04018c9-a87b-4473-8b5e-92ca22f7a619', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276bb73d-b96b-4a07-b982-b1f993b6573a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (276bb73d-b96b-4a07-b982-b1f993b6573a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d9ebea-c231-4097-8e71-65abb3abb076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:25 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Volume e04018c9-a87b-4473-8b5e-92ca22f7a619: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e04018c9-a87b-4473-8b5e-92ca22f7a619', 'volume_size': 1} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:25 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" returned: 0 in 0.697s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad, size 1024.00 MB, duration 6.13 sec, destination /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.012fd716-8cc1-4d61-9d54-23a2edc9cdd34k8wzdj6.img {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:50:25 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] Converted 1024.00 MB image at 167.11 MB/s Aug 09 12:50:25 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] 012fd716-8cc1-4d61-9d54-23a2edc9cdd3 was raw, no need to convert to raw {{(pid=89309) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 09 12:50:30 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-02d84664-ab54-40c3-9dd6-48932a0d3091 tempest-GroupsTest-1544032029 None] Group tempest-Group1-1785361311: creating Aug 09 12:50:30 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-02d84664-ab54-40c3-9dd6-48932a0d3091 tempest-GroupsTest-1544032029 None] Group tempest-Group1-1785361311: created successfully Aug 09 12:50:30 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-02d84664-ab54-40c3-9dd6-48932a0d3091 tempest-GroupsTest-1544032029 None] Create group completed successfully. Aug 09 12:50:31 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4f7e6cc8-ab79-4940-a17b-0ef1256cf978 tempest-GroupsTest-1544032029 None] Group tempest-Group2-1526417348: creating Aug 09 12:50:31 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4f7e6cc8-ab79-4940-a17b-0ef1256cf978 tempest-GroupsTest-1544032029 None] Group tempest-Group2-1526417348: created successfully Aug 09 12:50:31 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4f7e6cc8-ab79-4940-a17b-0ef1256cf978 tempest-GroupsTest-1544032029 None] Create group completed successfully. Aug 09 12:50:32 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:50:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Flow 'volume_create_manager' (32e43135-f488-48fa-a295-9132aed64444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:50:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d4b9bc-7c3c-4ac4-84ed-1e240fe329d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02d4b9bc-7c3c-4ac4-84ed-1e240fe329d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1942318725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ba44a8-7721-459c-8337-059c1a50677b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b698cbabdd040a499566d50d42c8259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:50:33Z,use_quota=True,user_id='f1b9a098df0044a3897fd21f934010c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12333d2b-d6e1-44a5-9744-5b2817919fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12333d2b-d6e1-44a5-9744-5b2817919fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8411bfc1-a695-45a0-9234-a86c9604d138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8411bfc1-a695-45a0-9234-a86c9604d138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '70ba44a8-7721-459c-8337-059c1a50677b', 'volume_name': 'volume-70ba44a8-7721-459c-8337-059c1a50677b', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fda452-a3a7-4289-99d5-0f9e4a99b36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69fda452-a3a7-4289-99d5-0f9e4a99b36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab03f26e-fe5c-448a-86e0-2c7fb149ebc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:33 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Volume 70ba44a8-7721-459c-8337-059c1a50677b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-70ba44a8-7721-459c-8337-059c1a50677b', 'volume_size': 1} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Flow 'volume_create_manager' (b1bebc42-3f55-4c2d-8526-584fb481b2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee03e346-1ba2-4f26-935f-8514c9800aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee03e346-1ba2-4f26-935f-8514c9800aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-210760031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d9bf1ef-559a-46c4-b210-cde65624c5f9,host='devstack@QuobyteHD#QuobyteHD',id=bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da0622ca7f84606969403e09dea7e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:50:33Z,use_quota=True,user_id='c41593c5e8a94d9da0d40e080a0ef2ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a9d730f-7d12-4f22-bd27-67cefa6ed691),volume_type_id=1a9d730f-7d12-4f22-bd27-67cefa6ed691)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79824c8-905d-4038-a05f-881d83a5bcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f79824c8-905d-4038-a05f-881d83a5bcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4fff8e-c701-455a-b0fe-c31612ac44c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4fff8e-c701-455a-b0fe-c31612ac44c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9', 'volume_name': 'volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c194f76d-b23b-480d-816e-e2ec04e3de21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c194f76d-b23b-480d-816e-e2ec04e3de21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e580a282-0ba5-4cb2-830c-168694688f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:33 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Volume bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9', 'volume_size': 1} Aug 09 12:50:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:43 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=39,cinder:UPDATE=38,cinder:DELETE=4,cinder:INSERT=8 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:50:43 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:INSERT=10,cinder:UPDATE=37,cinder:SELECT=39,cinder:DELETE=1 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:50:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.554s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] Uploaded volume to glance image-id: 012fd716-8cc1-4d61-9d54-23a2edc9cdd3. {{(pid=89309) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 09 12:50:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 20.910s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:50:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1452607124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e04018c9-a87b-4473-8b5e-92ca22f7a619,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f2e11cdf554d17ae5da880ae3b8efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:50:26Z,use_quota=True,user_id='e57a8fa6bd25481596ad73677a5ef89d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:50:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Creating volume e04018c9-a87b-4473-8b5e-92ca22f7a619 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:50:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:50:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:50:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:50:46 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:50:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:46 devstack sudo[99811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 1073741824 Aug 09 12:50:46 devstack sudo[99811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:46 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d3ddc290-34f9-47f6-a524-6476fbedef16 tempest-VolumesActionsTest-1743855873 None] Copy volume to image completed successfully. Aug 09 12:50:47 devstack sudo[99811]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 1073741824" returned: 0 in 0.457s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:47 devstack sudo[99816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 Aug 09 12:50:47 devstack sudo[99816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:47 devstack sudo[99816]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619" returned: 0 in 0.240s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.295s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1942318725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=70ba44a8-7721-459c-8337-059c1a50677b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b698cbabdd040a499566d50d42c8259',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:50:33Z,use_quota=True,user_id='f1b9a098df0044a3897fd21f934010c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Creating volume 70ba44a8-7721-459c-8337-059c1a50677b {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:50:47 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8d9ebea-c231-4097-8e71-65abb3abb076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e04018c9-a87b-4473-8b5e-92ca22f7a619', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:47 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b 1073741824 Aug 09 12:50:47 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca790ac6-8abb-4442-9b7d-fe82de802a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:47 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Volume volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 (e04018c9-a87b-4473-8b5e-92ca22f7a619): created successfully Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca790ac6-8abb-4442-9b7d-fe82de802a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Flow 'volume_create_manager' (44c67c24-de39-44b4-a6bb-173e3fc15efb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:50:47 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e625e152-58a2-4a17-8c51-225f93a9e21e tempest-VolumesSnapshotTestJSON-1187682763 None] Created volume successfully. Aug 09 12:50:47 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b 1073741824" returned: 0 in 0.433s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:47 devstack sudo[99824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b Aug 09 12:50:47 devstack sudo[99824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:48 devstack sudo[99824]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b" returned: 0 in 0.257s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.472s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=5d9bf1ef-559a-46c4-b210-cde65624c5f9,created_at=2026-08-09T10:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-210760031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=5d9bf1ef-559a-46c4-b210-cde65624c5f9,host='devstack@QuobyteHD#QuobyteHD',id=bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da0622ca7f84606969403e09dea7e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:50:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:50:33Z,use_quota=True,user_id='c41593c5e8a94d9da0d40e080a0ef2ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1a9d730f-7d12-4f22-bd27-67cefa6ed691),volume_type_id=1a9d730f-7d12-4f22-bd27-67cefa6ed691)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Creating volume bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:50:48 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab03f26e-fe5c-448a-86e0-2c7fb149ebc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-70ba44a8-7721-459c-8337-059c1a50677b', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:48 devstack sudo[99827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9 1073741824 Aug 09 12:50:48 devstack sudo[99827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4435ef5-8047-4e52-a933-86e2ccd70ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:48 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Volume volume-70ba44a8-7721-459c-8337-059c1a50677b (70ba44a8-7721-459c-8337-059c1a50677b): created successfully Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f4435ef5-8047-4e52-a933-86e2ccd70ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Flow 'volume_create_manager' (32e43135-f488-48fa-a295-9132aed64444) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:50:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-7a086959-cf28-4b3d-86fa-dcef75d2510f req-9e951b30-d22e-4de3-aefb-ab16abe2efda tempest-VolumesSnapshotsTestJSON-1266367837 None] Created volume successfully. Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:48 devstack sudo[99827]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9 1073741824" returned: 0 in 0.500s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:48 devstack sudo[99833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9 Aug 09 12:50:48 devstack sudo[99833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:48 devstack sudo[99833]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9" returned: 0 in 0.243s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.544s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] Creating offline snapshot fd4aa7ec-2f2d-438b-a96a-412165345c28 of volume e04018c9-a87b-4473-8b5e-92ca22f7a619 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e580a282-0ba5-4cb2-830c-168694688f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11dc3c89-babe-4efd-834e-25af9eabb7d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c73a8100-5e89-41c6-9a0d-5050b1ad84b9]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:48 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Volume volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9 (bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9): created successfully Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11dc3c89-babe-4efd-834e-25af9eabb7d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Flow 'volume_create_manager' (b1bebc42-3f55-4c2d-8526-584fb481b2b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:50:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1eb8cda4-84fb-4c97-9ab3-850f9786ca93 tempest-GroupsTest-1544032029 None] Created volume successfully. Aug 09 12:50:49 devstack sudo[99836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 Aug 09 12:50:49 devstack sudo[99836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:49 devstack sudo[99836]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619" returned: 0 in 0.378s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:49 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 1G Aug 09 12:50:49 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:49 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 1G" returned: 0 in 0.420s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:49 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 Aug 09 12:50:49 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:50 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28" returned: 0 in 0.314s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:50 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 is being set with open permissions: ugo+rw Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:50 devstack sudo[99853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 Aug 09 12:50:50 devstack sudo[99853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:50 devstack sudo[99853]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28" returned: 0 in 0.255s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:50 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.info Aug 09 12:50:50 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Acquiring lock "cinder-quobyte-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Lock "cinder-quobyte-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75e6bed-7190-4ab4-abf6-81046139b24c]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:50 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9 Aug 09 12:50:50 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:50 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.info" returned: 0 in 0.284s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:50 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.info is being set with open permissions: ugo+rw Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:50 devstack sudo[99861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.info Aug 09 12:50:50 devstack sudo[99861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:50 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9" returned: 0 in 0.365s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:50 devstack sudo[99867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9 Aug 09 12:50:50 devstack sudo[99867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:50 devstack sudo[99861]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.info" returned: 0 in 0.253s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.274s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7281df-87d3-4c44-b595-adc25fdc9207]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:50 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b7149f66-019f-492a-829e-797c1dea2733 tempest-VolumesSnapshotTestJSON-1187682763 None] Create snapshot completed successfully Aug 09 12:50:51 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad Aug 09 12:50:51 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:51 devstack sudo[99867]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9" returned: 0 in 0.255s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Lock "cinder-quobyte-bc5e02de-ceb8-4078-a6b5-6c6e364c4ea9" released by "delete_volume" :: held 0.663s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Created reservations ['c9baec7f-72b4-4970-9f4e-8565f82c79d3'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:50:51 devstack cinder-volume[89309]: WARNING cinder.quota [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1161196654 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1161196654, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:50:51 devstack cinder-volume[89309]: WARNING cinder.quota [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1161196654 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1161196654, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Created reservations ['6e0386fa-9215-420c-87d7-7bb58f6853bf', '2196e8b0-0720-47b8-80bf-2a42e195ee29', 'b54bd175-77e0-48e4-897d-d4e36acb75eb', 'f276a88e-238f-4336-bd94-1fdfc275b06a'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:50:51 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" returned: 0 in 0.391s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e213ca1-3a59-4446-88e7-2a262d3587a6]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:51 devstack sudo[99875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:50:51 devstack sudo[99875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:51 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad Aug 09 12:50:51 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:51 devstack sudo[99875]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.258s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:50:51 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-3d5b8a30-2eb8-47be-908b-d54d96486d17 tempest-GroupsTest-1544032029 None] Delete group completed successfully. Aug 09 12:50:51 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" returned: 0 in 0.422s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-3ef14bd9-a0c8-404a-a25b-d4db8cd0bb13 tempest-GroupsTest-1544032029 None] Created reservations ['28d9b441-0599-42f9-b637-7499fcf943fd'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:50:51 devstack sudo[99883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img Aug 09 12:50:51 devstack sudo[99883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3ef14bd9-a0c8-404a-a25b-d4db8cd0bb13 tempest-GroupsTest-1544032029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3ef14bd9-a0c8-404a-a25b-d4db8cd0bb13 tempest-GroupsTest-1544032029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3ef14bd9-a0c8-404a-a25b-d4db8cd0bb13 tempest-GroupsTest-1544032029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3ef14bd9-a0c8-404a-a25b-d4db8cd0bb13 tempest-GroupsTest-1544032029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3ef14bd9-a0c8-404a-a25b-d4db8cd0bb13 tempest-GroupsTest-1544032029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3ef14bd9-a0c8-404a-a25b-d4db8cd0bb13 tempest-GroupsTest-1544032029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:51 devstack sudo[99885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:50:51 devstack sudo[99885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:52 devstack sudo[99885]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3ef14bd9-a0c8-404a-a25b-d4db8cd0bb13 tempest-GroupsTest-1544032029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.302s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:52 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-3ef14bd9-a0c8-404a-a25b-d4db8cd0bb13 tempest-GroupsTest-1544032029 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:50:52 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-3ef14bd9-a0c8-404a-a25b-d4db8cd0bb13 tempest-GroupsTest-1544032029 None] Delete group completed successfully. Aug 09 12:50:53 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:50:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Flow 'volume_create_manager' (fb546c00-5122-48c6-a68f-a1b3262bfe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:50:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8f97df-988e-4861-bf4c-13ce0b97fffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb8f97df-988e-4861-bf4c-13ce0b97fffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:50:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-205637146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b974921-cfbc-41fb-962a-cb1a049825b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f2e11cdf554d17ae5da880ae3b8efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:50:54Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=fd4aa7ec-2f2d-438b-a96a-412165345c28,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:50:54Z,use_quota=True,user_id='e57a8fa6bd25481596ad73677a5ef89d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b60706-36b1-4071-bafc-105178cce884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b60706-36b1-4071-bafc-105178cce884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d00786-b316-46ef-8ec8-d29fea123384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3d00786-b316-46ef-8ec8-d29fea123384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2b974921-cfbc-41fb-962a-cb1a049825b9', 'volume_name': 'volume-2b974921-cfbc-41fb-962a-cb1a049825b9', 'volume_size': 2, 'snapshot_id': 'fd4aa7ec-2f2d-438b-a96a-412165345c28'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2879b2ab-c91c-48f2-8dbb-61bb5eea52c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2879b2ab-c91c-48f2-8dbb-61bb5eea52c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec314c5b-fdf4-471c-a60f-e5e38fc1b59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:53 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Volume 2b974921-cfbc-41fb-962a-cb1a049825b9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2b974921-cfbc-41fb-962a-cb1a049825b9', 'volume_size': 2, 'snapshot_id': 'fd4aa7ec-2f2d-438b-a96a-412165345c28'} Aug 09 12:50:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:54 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2f93c74b-5399-4892-b1c6-da40ecf873e9 tempest-GroupsTest-1544032029 None] Group tempest-GroupsTest-Group-1012735319: creating Aug 09 12:50:54 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2f93c74b-5399-4892-b1c6-da40ecf873e9 tempest-GroupsTest-1544032029 None] Group tempest-GroupsTest-Group-1012735319: created successfully Aug 09 12:50:54 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2f93c74b-5399-4892-b1c6-da40ecf873e9 tempest-GroupsTest-1544032029 None] Create group completed successfully. Aug 09 12:50:56 devstack sudo[99883]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img" returned: 0 in 4.544s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64e3573-dd95-4a43-a5a6-8004a262b7f2]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:56 devstack sudo[99906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad Aug 09 12:50:56 devstack sudo[99906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Flow 'volume_create_manager' (28ddf9ec-f0dd-4924-9bf9-974b1391a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbac58f-7730-4cfb-a40e-7326aa2c9d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dbac58f-7730-4cfb-a40e-7326aa2c9d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1711189186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13fc8662-46f6-48a6-966c-4718c10f40a4,host='devstack@QuobyteHD#QuobyteHD',id=74067e9a-2fcc-4114-b937-0e4970d05879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da0622ca7f84606969403e09dea7e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:50:56Z,use_quota=True,user_id='c41593c5e8a94d9da0d40e080a0ef2ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9754def8-e484-4ece-a821-7a36ccc918b3),volume_type_id=9754def8-e484-4ece-a821-7a36ccc918b3)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad51958-3234-4e7e-a404-3d451ac30a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6ad51958-3234-4e7e-a404-3d451ac30a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62fa7c5-412f-4445-bbd9-9b94327d8f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f62fa7c5-412f-4445-bbd9-9b94327d8f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74067e9a-2fcc-4114-b937-0e4970d05879', 'volume_name': 'volume-74067e9a-2fcc-4114-b937-0e4970d05879', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70d9264-579b-4342-a82b-024655eb15ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d70d9264-579b-4342-a82b-024655eb15ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369a4291-0e1f-4a49-9ae6-0bb0c3733f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:50:56 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Volume 74067e9a-2fcc-4114-b937-0e4970d05879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74067e9a-2fcc-4114-b937-0e4970d05879', 'volume_size': 1} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:56 devstack sudo[99906]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" returned: 0 in 0.538s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad, size 1024.00 MB, duration 4.54 sec, destination /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:50:56 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Converted 1024.00 MB image at 225.32 MB/s Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] 291b2da3-41a3-425d-8923-f5d74bdb8880 was raw, converting to qcow2 {{(pid=89309) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8574f63f-c9b4-4eda-b0db-d5172eadccf7]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:56 devstack sudo[99911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img Aug 09 12:50:56 devstack sudo[99911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:57 devstack sudo[99911]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img" returned: 0 in 0.324s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:57 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img Aug 09 12:50:57 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:57 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img" returned: 1 in 0.329s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img /opt/stack/data/cinder/conversion/vol_upload_34tzgt68 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:57 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img /opt/stack/data/cinder/conversion/vol_upload_34tzgt68 Aug 09 12:50:57 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:57 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:50:57 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:57 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img /opt/stack/data/cinder/conversion/vol_upload_34tzgt68" returned: 0 in 0.262s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Image conversion details: src /opt/stack/data/cinder/conversion/f915fa4a-25bb-4a27-a2d7-c9302b4543ad.temp_image.291b2da3-41a3-425d-8923-f5d74bdb8880166h1pvc.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_34tzgt68 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:50:57 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Converted 1024.00 MB image at 1024.00 MB/s Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef8a36b-1bf2-4ee8-91be-c8e3d04fb00d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_34tzgt68 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:57 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:57 devstack sudo[99927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_34tzgt68 Aug 09 12:50:57 devstack sudo[99927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.244s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:50:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:50:58 devstack sudo[99927]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_34tzgt68" returned: 0 in 0.323s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 8.465s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:50:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Uploaded volume to glance image-id: 291b2da3-41a3-425d-8923-f5d74bdb8880. {{(pid=89309) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 09 12:50:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.970s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:50:59 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] Creating offline snapshot b66539b4-b7b1-4ef9-b847-92d66cdfa722 of volume 70ba44a8-7721-459c-8337-059c1a50677b {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:50:59 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-26b30ed9-989c-4972-a868-96a2e1c08c41 tempest-VolumesActionsTest-1743855873 None] Copy volume to image completed successfully. Aug 09 12:50:59 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3656aae7-d577-4b1b-ad1b-b152138f10f6]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:50:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:59 devstack sudo[99933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b Aug 09 12:50:59 devstack sudo[99933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:50:59 devstack sudo[99933]: pam_unix(sudo:session): session closed for user root Aug 09 12:50:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b" returned: 0 in 0.357s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:50:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:50:59 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 1G Aug 09 12:50:59 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:00 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 1G" returned: 0 in 0.388s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ba44a8-7721-459c-8337-059c1a50677b -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:00 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ba44a8-7721-459c-8337-059c1a50677b -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 Aug 09 12:51:00 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:00 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-70ba44a8-7721-459c-8337-059c1a50677b -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722" returned: 0 in 0.317s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:00 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 is being set with open permissions: ugo+rw Aug 09 12:51:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:00 devstack sudo[99950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 Aug 09 12:51:00 devstack sudo[99950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:00 devstack sudo[99950]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722" returned: 0 in 0.254s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:00 devstack sudo[99953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.info Aug 09 12:51:00 devstack sudo[99953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Acquiring lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Acquiring lock "cinder-quobyte-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Lock "cinder-quobyte-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" acquired by "delete_volume" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:00 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8fc5ddd-febf-48e1-bfa1-b08953266771]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:01 devstack sudo[99953]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:01 devstack sudo[99955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad Aug 09 12:51:01 devstack sudo[99955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.info" returned: 0 in 0.277s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:01 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.info is being set with open permissions: ugo+rw Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:01 devstack sudo[99958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.info Aug 09 12:51:01 devstack sudo[99958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:01 devstack sudo[99958]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:01 devstack sudo[99955]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.info" returned: 0 in 0.244s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.292s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-fd4aa7ec-2f2d-438b-a96a-412165345c28-2b974921-cfbc-41fb-962a-cb1a049825b9" by "_create_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" returned: 0 in 0.379s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:01 devstack sudo[99964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad Aug 09 12:51:01 devstack sudo[99964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-fd4aa7ec-2f2d-438b-a96a-412165345c28-2b974921-cfbc-41fb-962a-cb1a049825b9" acquired by "_create_volume_from_snapshot" :: waited 0.037s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Creating volume 2b974921-cfbc-41fb-962a-cb1a049825b9 from snapshot fd4aa7ec-2f2d-438b-a96a-412165345c28 {{(pid=89309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-2b974921-cfbc-41fb-962a-cb1a049825b9" by "_copy_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:01 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-486be296-1429-491b-bf01-0b7f19755e3d req-3cabbb40-40a5-4166-bf3c-f1c6115c1ba0 tempest-VolumesSnapshotsTestJSON-1266367837 None] Create snapshot completed successfully Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-2b974921-cfbc-41fb-962a-cb1a049825b9" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] snapshot: fd4aa7ec-2f2d-438b-a96a-412165345c28, volume: 2b974921-cfbc-41fb-962a-cb1a049825b9, {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e03632dc-27bc-40c6-8f9f-067d9d005d20]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:01 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 Aug 09 12:51:01 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:01 devstack sudo[99964]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" returned: 0 in 0.278s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Lock "cinder-quobyte-f915fa4a-25bb-4a27-a2d7-c9302b4543ad" released by "delete_volume" :: held 0.695s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Acquiring lock "cinder-b66539b4-b7b1-4ef9-b847-92d66cdfa722-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "cinder-b66539b4-b7b1-4ef9-b847-92d66cdfa722-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Acquiring lock "cinder-quobyte-70ba44a8-7721-459c-8337-059c1a50677b" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "cinder-quobyte-70ba44a8-7721-459c-8337-059c1a50677b" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Acquiring lock "cinder-quobyte-b66539b4-b7b1-4ef9-b847-92d66cdfa722" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Created reservations ['135caecd-da94-4d54-999c-8dd04318a765', 'be758003-84d9-4abf-8ff9-c3b8bb450f3a', '1853f5b0-9359-4506-bbd5-8cdcc32a6982', 'ce4c193f-9cbe-465c-ab37-475bcb04c63f'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "cinder-quobyte-b66539b4-b7b1-4ef9-b847-92d66cdfa722" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Deleting offline snapshot b66539b4-b7b1-4ef9-b847-92d66cdfa722 of volume 70ba44a8-7721-459c-8337-059c1a50677b {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] snapshot_file for this snap is: volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9895a4c-ac10-4990-b817-a2d3a2c61354]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:01 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28" returned: 0 in 0.407s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e04018c9-a87b-4473-8b5e-92ca22f7a619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:51:01 devstack sudo[99973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:01 devstack sudo[99973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb4e4509-14e1-4d51-8b71-bb193b8bb8b6]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:01 devstack sudo[99970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 Aug 09 12:51:01 devstack sudo[99970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:01 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 Aug 09 12:51:01 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:02 devstack sudo[99973]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.257s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:02 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Deleted volume successfully. Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-97d7ad65-2533-45de-b21d-edf79aa60b99 tempest-VolumesActionsTest-1743855873 None] Lock "cinder-f915fa4a-25bb-4a27-a2d7-c9302b4543ad-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:02 devstack sudo[99970]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722" returned: 0 in 0.428s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-70ba44a8-7721-459c-8337-059c1a50677b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf836376-355d-41b2-996a-b03068d25c53]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:02 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619" returned: 0 in 0.437s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Creating direct copy from snapshot {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG cinder.utils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Path /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9 not found in is_blk_device check {{(pid=89309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:02 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9 Aug 09 12:51:02 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:02 devstack sudo[99986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b Aug 09 12:51:02 devstack sudo[99986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:02 devstack sudo[99986]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b" returned: 0 in 0.418s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:02 devstack sudo[99998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 Aug 09 12:51:02 devstack sudo[99998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:03 devstack sudo[99998]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722" returned: 0 in 0.658s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:03 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722 Aug 09 12:51:03 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:03 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b.b66539b4-b7b1-4ef9-b847-92d66cdfa722" returned: 0 in 0.653s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "cinder-quobyte-b66539b4-b7b1-4ef9-b847-92d66cdfa722" released by "_delete_snapshot" :: held 2.369s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "cinder-quobyte-70ba44a8-7721-459c-8337-059c1a50677b" released by "delete_snapshot" :: held 2.419s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:04 devstack cinder-volume[89309]: DEBUG cinder.quota [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Created reservations ['c3e8f734-657d-4b95-bf48-0ea367217bb0', '3eacd244-509a-4d59-9fa3-9de3995fd8a5', '53fe81a8-e16d-4984-baf8-6416ae99d746', '269fdc36-a9fb-4c99-a6a4-7011732442d8'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:04 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Delete snapshot completed successfully. Aug 09 12:51:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-1a2fd3f8-aed1-42d7-a5bc-2fa09deaa8b1 req-cef36198-d783-4771-a23f-34f69af281f8 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "cinder-b66539b4-b7b1-4ef9-b847-92d66cdfa722-delete_snapshot" released by "delete_snapshot" :: held 2.824s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Acquiring lock "cinder-70ba44a8-7721-459c-8337-059c1a50677b-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "cinder-70ba44a8-7721-459c-8337-059c1a50677b-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Acquiring lock "cinder-quobyte-70ba44a8-7721-459c-8337-059c1a50677b" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "cinder-quobyte-70ba44a8-7721-459c-8337-059c1a50677b" acquired by "delete_volume" :: waited 0.062s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:05 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad7c174-b60c-4704-af13-4a88f4a94551]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:05 devstack sudo[100015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b Aug 09 12:51:05 devstack sudo[100015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:06 devstack sudo[100015]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b" returned: 0 in 0.978s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:06 devstack sudo[100020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b Aug 09 12:51:06 devstack sudo[100020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:07 devstack sudo[100020]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-70ba44a8-7721-459c-8337-059c1a50677b" returned: 0 in 0.586s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "cinder-quobyte-70ba44a8-7721-459c-8337-059c1a50677b" released by "delete_volume" :: held 1.735s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.quota [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Created reservations ['d591884b-fe5f-4c4e-947e-cee4e635645e', '7e7cc810-544b-4795-b374-252c693f4bc6', '5120d383-dd86-4f33-90a8-575f383aaa91', '400c2b86-c81d-4316-bc8e-c78d2901dbf0'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:07 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9" returned: 0 in 5.248s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619, size 1024.00 MB, duration 5.25 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:51:07 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Converted 1024.00 MB image at 195.06 MB/s Aug 09 12:51:07 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9 is being set with open permissions: ugo+rw Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:07 devstack sudo[100023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:07 devstack sudo[100023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:07 devstack sudo[100024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9 Aug 09 12:51:07 devstack sudo[100024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:07 devstack sudo[100023]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.256s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.manager [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:07 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Deleted volume successfully. Aug 09 12:51:07 devstack sudo[100024]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9" returned: 0 in 0.270s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-2b974921-cfbc-41fb-962a-cb1a049825b9" released by "_copy_volume_from_snapshot" :: held 6.456s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-cc5a8b82-c8db-4868-9cee-a6d10e686d16 req-33172374-5d6b-41bb-b8ea-c55133abf9e3 tempest-VolumesSnapshotsTestJSON-1266367837 None] Lock "cinder-70ba44a8-7721-459c-8337-059c1a50677b-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-fd4aa7ec-2f2d-438b-a96a-412165345c28-2b974921-cfbc-41fb-962a-cb1a049825b9" released by "_create_volume_from_snapshot" :: held 6.543s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.582s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.310s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=13fc8662-46f6-48a6-966c-4718c10f40a4,created_at=2026-08-09T10:50:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1711189186',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13fc8662-46f6-48a6-966c-4718c10f40a4,host='devstack@QuobyteHD#QuobyteHD',id=74067e9a-2fcc-4114-b937-0e4970d05879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da0622ca7f84606969403e09dea7e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:50:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:50:56Z,use_quota=True,user_id='c41593c5e8a94d9da0d40e080a0ef2ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9754def8-e484-4ece-a821-7a36ccc918b3),volume_type_id=9754def8-e484-4ece-a821-7a36ccc918b3)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Creating volume 74067e9a-2fcc-4114-b937-0e4970d05879 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:51:07 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-74067e9a-2fcc-4114-b937-0e4970d05879 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec314c5b-fdf4-471c-a60f-e5e38fc1b59a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b974921-cfbc-41fb-962a-cb1a049825b9', 'volume_size': 2, 'snapshot_id': 'fd4aa7ec-2f2d-438b-a96a-412165345c28'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:07 devstack sudo[100029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-74067e9a-2fcc-4114-b937-0e4970d05879 1073741824 Aug 09 12:51:07 devstack sudo[100029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fcae53-bdd9-4692-8ec2-270f603ced0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:07 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Volume volume-2b974921-cfbc-41fb-962a-cb1a049825b9 (2b974921-cfbc-41fb-962a-cb1a049825b9): created successfully Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44fcae53-bdd9-4692-8ec2-270f603ced0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Flow 'volume_create_manager' (fb546c00-5122-48c6-a68f-a1b3262bfe32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:08 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-6caa7c89-f78a-4a70-a93a-629ce690552f tempest-VolumesSnapshotTestJSON-1187682763 None] Created volume successfully. Aug 09 12:51:08 devstack sudo[100029]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-74067e9a-2fcc-4114-b937-0e4970d05879 1073741824" returned: 0 in 0.548s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-74067e9a-2fcc-4114-b937-0e4970d05879 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:08 devstack sudo[100035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-74067e9a-2fcc-4114-b937-0e4970d05879 Aug 09 12:51:08 devstack sudo[100035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:08 devstack sudo[100035]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-74067e9a-2fcc-4114-b937-0e4970d05879" returned: 0 in 0.237s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] <== create_volume: return (829ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:51:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (369a4291-0e1f-4a49-9ae6-0bb0c3733f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74067e9a-2fcc-4114-b937-0e4970d05879', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9aba93-0a1a-4847-acd4-2bf3fb6c3ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:08 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Volume volume-74067e9a-2fcc-4114-b937-0e4970d05879 (74067e9a-2fcc-4114-b937-0e4970d05879): created successfully Aug 09 12:51:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a9aba93-0a1a-4847-acd4-2bf3fb6c3ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Flow 'volume_create_manager' (28ddf9ec-f0dd-4924-9bf9-974b1391a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:08 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-aa199a21-14f1-4f8f-984e-5be2b02ac739 tempest-GroupsTest-1544032029 None] Created volume successfully. Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-2b974921-cfbc-41fb-962a-cb1a049825b9-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-2b974921-cfbc-41fb-962a-cb1a049825b9-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-2b974921-cfbc-41fb-962a-cb1a049825b9" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-2b974921-cfbc-41fb-962a-cb1a049825b9" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d5d349-1e6a-4fec-bfa0-75308a30874d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:09 devstack sudo[100038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9 Aug 09 12:51:09 devstack sudo[100038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Flow 'volume_create_manager' (6ffff58f-19c6-469b-8694-ab0178d7e353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f5879c-2535-4e45-91a2-8b66f696f2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33f5879c-2535-4e45-91a2-8b66f696f2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519549942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13fc8662-46f6-48a6-966c-4718c10f40a4,host='devstack@QuobyteHD#QuobyteHD',id=f19a3570-da41-4595-98a2-646dfa5199a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da0622ca7f84606969403e09dea7e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:10Z,use_quota=True,user_id='c41593c5e8a94d9da0d40e080a0ef2ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9754def8-e484-4ece-a821-7a36ccc918b3),volume_type_id=9754def8-e484-4ece-a821-7a36ccc918b3)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8072e67b-071d-4ead-b982-1b5539771941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8072e67b-071d-4ead-b982-1b5539771941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd8ba3b-39f3-4b71-8c55-ab61f63c0723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdd8ba3b-39f3-4b71-8c55-ab61f63c0723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f19a3570-da41-4595-98a2-646dfa5199a1', 'volume_name': 'volume-f19a3570-da41-4595-98a2-646dfa5199a1', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12c02cd-3b2a-47aa-92db-cb59af8deab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d12c02cd-3b2a-47aa-92db-cb59af8deab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33b48cc-1bfe-4e1e-b3be-f8ea902fb65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:09 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Volume f19a3570-da41-4595-98a2-646dfa5199a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f19a3570-da41-4595-98a2-646dfa5199a1', 'volume_size': 1} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=13fc8662-46f6-48a6-966c-4718c10f40a4,created_at=2026-08-09T10:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1519549942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=13fc8662-46f6-48a6-966c-4718c10f40a4,host='devstack@QuobyteHD#QuobyteHD',id=f19a3570-da41-4595-98a2-646dfa5199a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8da0622ca7f84606969403e09dea7e18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:10Z,use_quota=True,user_id='c41593c5e8a94d9da0d40e080a0ef2ae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9754def8-e484-4ece-a821-7a36ccc918b3),volume_type_id=9754def8-e484-4ece-a821-7a36ccc918b3)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Creating volume f19a3570-da41-4595-98a2-646dfa5199a1 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:09 devstack sudo[100038]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:51:09 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f19a3570-da41-4595-98a2-646dfa5199a1 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9" returned: 0 in 0.613s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:09 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f19a3570-da41-4595-98a2-646dfa5199a1 1073741824 Aug 09 12:51:09 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:09 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9 Aug 09 12:51:09 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:10 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b974921-cfbc-41fb-962a-cb1a049825b9" returned: 0 in 0.330s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-2b974921-cfbc-41fb-962a-cb1a049825b9" released by "delete_volume" :: held 1.022s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Created reservations ['822ce18d-5f51-41e6-b793-d3457ac3d952', '8266259c-e13c-45fb-8132-33271f39bb1a', '1905c115-24f5-409f-a2af-812baa6f0f0f', '21ec875a-fd42-487c-88f3-4993ebfaefe3'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:10 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:10 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:10 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f19a3570-da41-4595-98a2-646dfa5199a1 1073741824" returned: 0 in 0.644s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f19a3570-da41-4595-98a2-646dfa5199a1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:10 devstack sudo[100056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f19a3570-da41-4595-98a2-646dfa5199a1 Aug 09 12:51:10 devstack sudo[100056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:10 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.379s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:10 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Deleted volume successfully. Aug 09 12:51:10 devstack sudo[100056]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f19a3570-da41-4595-98a2-646dfa5199a1" returned: 0 in 0.328s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-517a7af3-7a2b-44c2-b83b-7a8fff4f70e0 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-2b974921-cfbc-41fb-962a-cb1a049825b9-delete_volume" released by "delete_volume" :: held 1.732s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e33b48cc-1bfe-4e1e-b3be-f8ea902fb65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f19a3570-da41-4595-98a2-646dfa5199a1', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ea14b5-7725-4290-9fc4-ef9c07013d25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:10 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Volume volume-f19a3570-da41-4595-98a2-646dfa5199a1 (f19a3570-da41-4595-98a2-646dfa5199a1): created successfully Aug 09 12:51:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4ea14b5-7725-4290-9fc4-ef9c07013d25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Flow 'volume_create_manager' (6ffff58f-19c6-469b-8694-ab0178d7e353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-9059ca4e-43eb-4f18-be2f-cf37031c555e tempest-GroupsTest-1544032029 None] Created volume successfully. Aug 09 12:51:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-fd4aa7ec-2f2d-438b-a96a-412165345c28-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-fd4aa7ec-2f2d-438b-a96a-412165345c28-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-e04018c9-a87b-4473-8b5e-92ca22f7a619" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-e04018c9-a87b-4473-8b5e-92ca22f7a619" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-fd4aa7ec-2f2d-438b-a96a-412165345c28" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-fd4aa7ec-2f2d-438b-a96a-412165345c28" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Deleting offline snapshot fd4aa7ec-2f2d-438b-a96a-412165345c28 of volume e04018c9-a87b-4473-8b5e-92ca22f7a619 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:51:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] snapshot_file for this snap is: volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:51:11 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bebff39-d873-42c4-b908-4a830b0922e4]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:11 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 Aug 09 12:51:11 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:12 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28" returned: 0 in 0.418s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e04018c9-a87b-4473-8b5e-92ca22f7a619(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[721b042d-726b-4bc9-867f-b8bb3673c94a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:12 devstack sudo[100066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 Aug 09 12:51:12 devstack sudo[100066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:12 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-16160929-02dd-4db2-8551-c5a08060c0ed tempest-GroupsTest-1544032029 None] Update group completed successfully. Aug 09 12:51:12 devstack sudo[100066]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619" returned: 0 in 0.699s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:12 devstack sudo[100071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 Aug 09 12:51:12 devstack sudo[100071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Flow 'volume_create_manager' (fc6708bb-6413-4e0b-be2e-1c4411bc9602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ccf192-256f-439c-b332-df1f866028e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ccf192-256f-439c-b332-df1f866028e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-378665076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f7e92a-4f82-49f8-80d0-32c60474f028,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0632de27041f466f87506dadebed16fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:13Z,use_quota=True,user_id='923011fe03ed4a2091a933de3794d853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e3bdd8-60c7-46d8-9640-b7ed610a4ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e3bdd8-60c7-46d8-9640-b7ed610a4ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b4d729-1507-46e0-95ba-194807f3142f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b4d729-1507-46e0-95ba-194807f3142f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65f7e92a-4f82-49f8-80d0-32c60474f028', 'volume_name': 'volume-65f7e92a-4f82-49f8-80d0-32c60474f028', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7084a873-0403-4c52-bc02-63c4a33a3e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7084a873-0403-4c52-bc02-63c4a33a3e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ec33b7-311e-40fe-a922-732c9d65b9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:13 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Volume 65f7e92a-4f82-49f8-80d0-32c60474f028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65f7e92a-4f82-49f8-80d0-32c60474f028', 'volume_size': 1} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-378665076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65f7e92a-4f82-49f8-80d0-32c60474f028,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0632de27041f466f87506dadebed16fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:13Z,use_quota=True,user_id='923011fe03ed4a2091a933de3794d853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Creating volume 65f7e92a-4f82-49f8-80d0-32c60474f028 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:51:13 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-65f7e92a-4f82-49f8-80d0-32c60474f028 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:13 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-65f7e92a-4f82-49f8-80d0-32c60474f028 1073741824 Aug 09 12:51:13 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:13 devstack sudo[100071]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28" returned: 0 in 0.389s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:13 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28 Aug 09 12:51:13 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:13 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619.fd4aa7ec-2f2d-438b-a96a-412165345c28" returned: 0 in 0.330s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:13 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-65f7e92a-4f82-49f8-80d0-32c60474f028 1073741824" returned: 0 in 0.535s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-fd4aa7ec-2f2d-438b-a96a-412165345c28" released by "_delete_snapshot" :: held 1.967s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-e04018c9-a87b-4473-8b5e-92ca22f7a619" released by "delete_snapshot" :: held 1.993s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-65f7e92a-4f82-49f8-80d0-32c60474f028 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:13 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-65f7e92a-4f82-49f8-80d0-32c60474f028 Aug 09 12:51:13 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Created reservations ['f0e369df-64f0-48d3-8b18-940fb1cc8caa', 'ed8594e9-6a34-422c-acc6-4b99ee937de9', 'bdb51772-bf43-41ae-9ee9-e41e28e479f8', '192756f0-5202-4184-a65f-4f39bac51285'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:13 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Delete snapshot completed successfully. Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-353d06a4-2834-4ae0-8a36-fadf346a8c8c tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-fd4aa7ec-2f2d-438b-a96a-412165345c28-delete_snapshot" released by "delete_snapshot" :: held 2.232s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:13 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f1f2880b-3114-4f02-b079-b078dc001818 tempest-GroupsTest-1544032029 None] Update group completed successfully. Aug 09 12:51:13 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-65f7e92a-4f82-49f8-80d0-32c60474f028" returned: 0 in 0.329s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (05ec33b7-311e-40fe-a922-732c9d65b9c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65f7e92a-4f82-49f8-80d0-32c60474f028', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec10529d-abc4-4fc3-9fec-cdfbcf6f162d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:13 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Volume volume-65f7e92a-4f82-49f8-80d0-32c60474f028 (65f7e92a-4f82-49f8-80d0-32c60474f028): created successfully Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec10529d-abc4-4fc3-9fec-cdfbcf6f162d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Flow 'volume_create_manager' (fc6708bb-6413-4e0b-be2e-1c4411bc9602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:14 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-227f93d7-0b49-4cf2-9531-7edf16e6d2d1 tempest-VolumesTestJSON-1438328188 None] Created volume successfully. Aug 09 12:51:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-e04018c9-a87b-4473-8b5e-92ca22f7a619-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-e04018c9-a87b-4473-8b5e-92ca22f7a619-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-e04018c9-a87b-4473-8b5e-92ca22f7a619" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-e04018c9-a87b-4473-8b5e-92ca22f7a619" acquired by "delete_volume" :: waited 0.025s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fadba9f7-8f59-48d9-aa88-25ee8ad0e7c5]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:15 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 Aug 09 12:51:15 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:15 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619" returned: 0 in 0.468s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:15 devstack sudo[100096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619 Aug 09 12:51:15 devstack sudo[100096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Acquiring lock "cinder-quobyte-74067e9a-2fcc-4114-b937-0e4970d05879" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Lock "cinder-quobyte-74067e9a-2fcc-4114-b937-0e4970d05879" acquired by "delete_volume" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[49b35421-0bff-4fc5-8ed6-b07ee403ca75]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-74067e9a-2fcc-4114-b937-0e4970d05879 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:15 devstack sudo[100096]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e04018c9-a87b-4473-8b5e-92ca22f7a619" returned: 0 in 0.310s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-e04018c9-a87b-4473-8b5e-92ca22f7a619" released by "delete_volume" :: held 0.897s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Flow 'volume_create_manager' (ff8a89c1-3765-45d3-875a-06de5ef251d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8dd9634-5e3c-4b4e-a83d-77c39d918ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8dd9634-5e3c-4b4e-a83d-77c39d918ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-278153888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628361da-759b-4345-aec8-91f6bd3a2e14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0632de27041f466f87506dadebed16fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:16Z,use_quota=True,user_id='923011fe03ed4a2091a933de3794d853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f3a6f1-e15f-49a2-bb8f-c60302594a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f3a6f1-e15f-49a2-bb8f-c60302594a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c19624c-a168-49ce-befd-1280b980f08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c19624c-a168-49ce-befd-1280b980f08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '628361da-759b-4345-aec8-91f6bd3a2e14', 'volume_name': 'volume-628361da-759b-4345-aec8-91f6bd3a2e14', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:15 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-74067e9a-2fcc-4114-b937-0e4970d05879 Aug 09 12:51:15 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65918c2-5296-4932-8930-0ea3fa6e216c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c65918c2-5296-4932-8930-0ea3fa6e216c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26deeb72-bb57-4515-96a5-2f62af6fcfe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:15 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Volume 628361da-759b-4345-aec8-91f6bd3a2e14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-628361da-759b-4345-aec8-91f6bd3a2e14', 'volume_size': 1} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-278153888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=628361da-759b-4345-aec8-91f6bd3a2e14,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0632de27041f466f87506dadebed16fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:16Z,use_quota=True,user_id='923011fe03ed4a2091a933de3794d853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Creating volume 628361da-759b-4345-aec8-91f6bd3a2e14 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:51:16 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-628361da-759b-4345-aec8-91f6bd3a2e14 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:16 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-628361da-759b-4345-aec8-91f6bd3a2e14 1073741824 Aug 09 12:51:16 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Created reservations ['93541744-b901-49d6-9606-db910e522623', '6649d3e9-0508-4d7f-ad5d-d4ddc303a78d', '9892a259-5443-4114-bf2e-04662b377e56', '75a3f658-beb2-41d3-b4a0-d9ff0f6b20f4'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:16 devstack sudo[100103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:16 devstack sudo[100103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:16 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-74067e9a-2fcc-4114-b937-0e4970d05879" returned: 0 in 0.479s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-74067e9a-2fcc-4114-b937-0e4970d05879 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:16 devstack sudo[100110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-74067e9a-2fcc-4114-b937-0e4970d05879 Aug 09 12:51:16 devstack sudo[100110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:16 devstack sudo[100103]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.299s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Deleted volume successfully. Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-89351bd0-7a78-4fe4-beb4-aa2a983007d2 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-e04018c9-a87b-4473-8b5e-92ca22f7a619-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:16 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-628361da-759b-4345-aec8-91f6bd3a2e14 1073741824" returned: 0 in 0.535s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-628361da-759b-4345-aec8-91f6bd3a2e14 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:16 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-628361da-759b-4345-aec8-91f6bd3a2e14 Aug 09 12:51:16 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:16 devstack sudo[100110]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-74067e9a-2fcc-4114-b937-0e4970d05879" returned: 0 in 0.348s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Lock "cinder-quobyte-74067e9a-2fcc-4114-b937-0e4970d05879" released by "delete_volume" :: held 0.872s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Acquiring lock "cinder-quobyte-f19a3570-da41-4595-98a2-646dfa5199a1" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Lock "cinder-quobyte-f19a3570-da41-4595-98a2-646dfa5199a1" acquired by "delete_volume" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7756b4b-922f-4854-ab9f-bd2fdc749594]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f19a3570-da41-4595-98a2-646dfa5199a1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:16 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f19a3570-da41-4595-98a2-646dfa5199a1 Aug 09 12:51:16 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:16 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-628361da-759b-4345-aec8-91f6bd3a2e14" returned: 0 in 0.276s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26deeb72-bb57-4515-96a5-2f62af6fcfe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-628361da-759b-4345-aec8-91f6bd3a2e14', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0716fedf-a6c6-4873-a6fd-682739cdac70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:16 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Volume volume-628361da-759b-4345-aec8-91f6bd3a2e14 (628361da-759b-4345-aec8-91f6bd3a2e14): created successfully Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0716fedf-a6c6-4873-a6fd-682739cdac70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Flow 'volume_create_manager' (ff8a89c1-3765-45d3-875a-06de5ef251d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-55d50615-d7c8-414b-aba1-8f7b26335414 tempest-VolumesTestJSON-1438328188 None] Created volume successfully. Aug 09 12:51:17 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f19a3570-da41-4595-98a2-646dfa5199a1" returned: 0 in 0.398s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f19a3570-da41-4595-98a2-646dfa5199a1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:17 devstack sudo[100125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f19a3570-da41-4595-98a2-646dfa5199a1 Aug 09 12:51:17 devstack sudo[100125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:17 devstack sudo[100125]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f19a3570-da41-4595-98a2-646dfa5199a1" returned: 0 in 0.271s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Lock "cinder-quobyte-f19a3570-da41-4595-98a2-646dfa5199a1" released by "delete_volume" :: held 0.725s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Created reservations ['2074b03b-c3b2-47e1-92f4-2f5591129bfd'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:17 devstack cinder-volume[89309]: WARNING cinder.quota [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-566331998 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-566331998, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:51:17 devstack cinder-volume[89309]: WARNING cinder.quota [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-566331998 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-566331998, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Created reservations ['21afbebc-c93a-4960-aca1-11e1e5993ebf', 'd451eb89-a155-4be2-b452-0228f3b9424f', '026345c3-d528-438e-bdc1-88829ff94e8d', '8977fd57-deee-4b1f-8934-abec39f24a18'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Created reservations ['3c194fa3-5257-4a86-bcec-d771d0fe7072', 'ee0cc48b-4e06-4d5a-b592-c4106688cc7f', 'b6a1347e-ed5e-4684-b07b-209e49a77e5c', '6d43a60a-c297-4a6e-bfc6-d8777708743a'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Flow 'volume_create_manager' (0eb794bc-ad0d-4da1-9cc1-4f57d3b18df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88f3c11-dfcf-4eac-8d30-cb036ef87ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88f3c11-dfcf-4eac-8d30-cb036ef87ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1205717804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f2e11cdf554d17ae5da880ae3b8efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:18Z,use_quota=True,user_id='e57a8fa6bd25481596ad73677a5ef89d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b3fe35-3b4b-4da3-bec3-c6f5d1d0b48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b3fe35-3b4b-4da3-bec3-c6f5d1d0b48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e70183-46d1-4a4a-9b3d-f666210df6d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21e70183-46d1-4a4a-9b3d-f666210df6d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9', 'volume_name': 'volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7fcf0da-82a3-4d95-b037-2dc1a0f35e9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7fcf0da-82a3-4d95-b037-2dc1a0f35e9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c6d177-cf0d-4469-b1e4-fa532d66f4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:17 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Volume c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9', 'volume_size': 1} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1205717804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f2e11cdf554d17ae5da880ae3b8efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:18Z,use_quota=True,user_id='e57a8fa6bd25481596ad73677a5ef89d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Creating volume c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:51:17 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:51:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:17 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 1073741824 Aug 09 12:51:17 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:18 devstack sudo[100130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:18 devstack sudo[100130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:18 devstack sudo[100130]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.418s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:18 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d3fefbc4-4f76-4ec0-8e1a-ebdc348f5e23 tempest-GroupsTest-1544032029 None] Delete group completed successfully. Aug 09 12:51:18 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 1073741824" returned: 0 in 0.684s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:18 devstack sudo[100136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 Aug 09 12:51:18 devstack sudo[100136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Flow 'volume_create_manager' (dc9e9534-2ac0-4fc3-82b4-3a4bf2449aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d2e443-f1bd-441d-8bca-20f53709bf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07d2e443-f1bd-441d-8bca-20f53709bf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1971744659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0632de27041f466f87506dadebed16fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:19Z,use_quota=True,user_id='923011fe03ed4a2091a933de3794d853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882543ad-782b-464c-b317-905bfe78e6fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (882543ad-782b-464c-b317-905bfe78e6fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c84361b-3c12-4ea1-9520-694b28aa5815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c84361b-3c12-4ea1-9520-694b28aa5815) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d', 'volume_name': 'volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c651ad9c-2c9c-4937-be71-6b30ad3abaf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c651ad9c-2c9c-4937-be71-6b30ad3abaf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9420a7-80f9-4083-a692-eab56d38a2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:18 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Volume 0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d', 'volume_size': 1} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:18 devstack sudo[100136]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9" returned: 0 in 0.332s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.116s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1971744659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0632de27041f466f87506dadebed16fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:19Z,use_quota=True,user_id='923011fe03ed4a2091a933de3794d853',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Creating volume 0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:51:19 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:19 devstack sudo[100139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d 1073741824 Aug 09 12:51:19 devstack sudo[100139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c6d177-cf0d-4469-b1e4-fa532d66f4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a654bb-0799-43de-ab35-226d93d909fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:19 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Volume volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 (c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9): created successfully Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1a654bb-0799-43de-ab35-226d93d909fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Flow 'volume_create_manager' (0eb794bc-ad0d-4da1-9cc1-4f57d3b18df4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:19 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ef8aba01-1737-4624-a37d-ba805f44994e tempest-VolumesSnapshotTestJSON-1187682763 None] Created volume successfully. Aug 09 12:51:19 devstack sudo[100139]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d 1073741824" returned: 0 in 0.560s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:19 devstack sudo[100146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d Aug 09 12:51:19 devstack sudo[100146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:19 devstack sudo[100146]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d" returned: 0 in 0.291s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b9420a7-80f9-4083-a692-eab56d38a2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdd218c-eac9-429d-85f9-fba853671f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:19 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Volume volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d (0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d): created successfully Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fdd218c-eac9-429d-85f9-fba853671f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Flow 'volume_create_manager' (dc9e9534-2ac0-4fc3-82b4-3a4bf2449aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:20 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-657b3711-6223-4b8c-9956-73b331e8aab5 tempest-VolumesTestJSON-1438328188 None] Created volume successfully. Aug 09 12:51:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] Creating offline snapshot 47bfa014-9a85-4b64-8cde-d155d496e782 of volume c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:51:20 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6665c36b-d8c7-4e47-9811-3bae2eb9f168]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:20 devstack sudo[100150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 Aug 09 12:51:20 devstack sudo[100150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:20 devstack sudo[100150]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9" returned: 0 in 0.418s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:20 devstack sudo[100155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 1G Aug 09 12:51:20 devstack sudo[100155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:21 devstack sudo[100155]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 1G" returned: 0 in 0.542s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:21 devstack sudo[100161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 Aug 09 12:51:21 devstack sudo[100161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:21 devstack sudo[100161]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782" returned: 0 in 0.395s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:21 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 is being set with open permissions: ugo+rw Aug 09 12:51:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:21 devstack sudo[100166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 Aug 09 12:51:21 devstack sudo[100166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:22 devstack sudo[100166]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782" returned: 0 in 0.428s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:22 devstack sudo[100169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.info Aug 09 12:51:22 devstack sudo[100169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Acquiring lock "cinder-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Lock "cinder-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Acquiring lock "cinder-quobyte-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Lock "cinder-quobyte-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d" acquired by "delete_volume" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:22 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e225e8b-4fce-4e8c-a436-29a21cc7fbc6]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:22 devstack sudo[100169]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.info" returned: 0 in 0.479s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:22 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.info is being set with open permissions: ugo+rw Aug 09 12:51:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:22 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d Aug 09 12:51:22 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:22 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.info Aug 09 12:51:22 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:22 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d" returned: 0 in 0.561s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:22 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.info" returned: 0 in 0.376s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:23 devstack sudo[100180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d Aug 09 12:51:23 devstack sudo[100180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.860s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:23 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-0ee566b4-93dd-410c-9bbf-74ee46b7af72 tempest-VolumesSnapshotTestJSON-1187682763 None] Create snapshot completed successfully Aug 09 12:51:23 devstack sudo[100180]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d" returned: 0 in 0.298s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Lock "cinder-quobyte-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d" released by "delete_volume" :: held 0.930s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:23 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Created reservations ['00f81d74-30ca-4d36-b946-2a0df4de76d8', '3d35897b-c9a7-487f-8da4-2e6951f89322', 'ef8a0c22-c1c3-4b4c-8b06-b8f75eab0048', '6307ec8e-20d0-4998-9154-6ac7bbfbaf0e'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:23 devstack sudo[100183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:23 devstack sudo[100183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:24 devstack sudo[100183]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.511s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:24 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Deleted volume successfully. Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61dbc0ff-f676-4f5f-8a11-bbb71148c30f tempest-VolumesTestJSON-1438328188 None] Lock "cinder-0e4a17d9-f6e7-4f36-a774-0bfdf7a1dc9d-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Flow 'volume_create_manager' (f2d80952-0a75-4c7b-bd52-879f2814a7a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d30579-8056-4381-9bcf-5717b9fc428f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66d30579-8056-4381-9bcf-5717b9fc428f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-482922239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b1ff98-6fe3-4349-a537-eb02d59d136a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5f2e11cdf554d17ae5da880ae3b8efb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=47bfa014-9a85-4b64-8cde-d155d496e782,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:24Z,use_quota=True,user_id='e57a8fa6bd25481596ad73677a5ef89d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f598cdbb-e87b-4eea-bf31-76e6e5ae3f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f598cdbb-e87b-4eea-bf31-76e6e5ae3f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (addfd5a8-2814-4c17-98e8-d7e5c0ffa033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (addfd5a8-2814-4c17-98e8-d7e5c0ffa033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd3b1ff98-6fe3-4349-a537-eb02d59d136a', 'volume_name': 'volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a', 'volume_size': 1, 'snapshot_id': '47bfa014-9a85-4b64-8cde-d155d496e782'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3578a4d5-3a8f-4c18-8423-b2bc89674f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3578a4d5-3a8f-4c18-8423-b2bc89674f69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe80409-5288-4d95-9217-30010e274401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:24 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Volume d3b1ff98-6fe3-4349-a537-eb02d59d136a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a', 'volume_size': 1, 'snapshot_id': '47bfa014-9a85-4b64-8cde-d155d496e782'} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-47bfa014-9a85-4b64-8cde-d155d496e782-d3b1ff98-6fe3-4349-a537-eb02d59d136a" by "_create_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-47bfa014-9a85-4b64-8cde-d155d496e782-d3b1ff98-6fe3-4349-a537-eb02d59d136a" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Creating volume d3b1ff98-6fe3-4349-a537-eb02d59d136a from snapshot 47bfa014-9a85-4b64-8cde-d155d496e782 {{(pid=89309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-d3b1ff98-6fe3-4349-a537-eb02d59d136a" by "_copy_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-d3b1ff98-6fe3-4349-a537-eb02d59d136a" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] snapshot: 47bfa014-9a85-4b64-8cde-d155d496e782, volume: d3b1ff98-6fe3-4349-a537-eb02d59d136a, {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8bec4b-f6cb-4e69-a12d-e0ff1dc5f4bf]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Acquiring lock "cinder-628361da-759b-4345-aec8-91f6bd3a2e14-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Lock "cinder-628361da-759b-4345-aec8-91f6bd3a2e14-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:24 devstack sudo[100186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 Aug 09 12:51:24 devstack sudo[100186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Acquiring lock "cinder-quobyte-628361da-759b-4345-aec8-91f6bd3a2e14" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Lock "cinder-quobyte-628361da-759b-4345-aec8-91f6bd3a2e14" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa37398-418d-4fda-8a05-4a81aa28ddaa]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-628361da-759b-4345-aec8-91f6bd3a2e14 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:24 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-628361da-759b-4345-aec8-91f6bd3a2e14 Aug 09 12:51:24 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:24 devstack sudo[100186]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782" returned: 0 in 0.412s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a88f02d-2878-49a9-8bce-3b814b3fca07]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:25 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 Aug 09 12:51:25 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:25 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-628361da-759b-4345-aec8-91f6bd3a2e14" returned: 0 in 0.451s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-628361da-759b-4345-aec8-91f6bd3a2e14 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:25 devstack sudo[100199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-628361da-759b-4345-aec8-91f6bd3a2e14 Aug 09 12:51:25 devstack sudo[100199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:25 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9" returned: 0 in 0.441s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Creating direct copy from snapshot {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG cinder.utils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Path /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a not found in is_blk_device check {{(pid=89309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:25 devstack sudo[100204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a Aug 09 12:51:25 devstack sudo[100204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:25 devstack sudo[100199]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-628361da-759b-4345-aec8-91f6bd3a2e14" returned: 0 in 0.283s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Lock "cinder-quobyte-628361da-759b-4345-aec8-91f6bd3a2e14" released by "delete_volume" :: held 0.791s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Created reservations ['dd8370b7-4be1-44cf-a64c-eb7b91e508d3', 'f6c8e1c1-bbab-4fd6-bbf7-23b3628dc14a', '02af16dd-b4a3-4fae-9bc0-94632505025f', '87aa744d-8dc9-4026-9db1-fbb796cdd25c'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:25 devstack sudo[100210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:25 devstack sudo[100210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Acquiring lock "cinder-65f7e92a-4f82-49f8-80d0-32c60474f028-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Lock "cinder-65f7e92a-4f82-49f8-80d0-32c60474f028-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Acquiring lock "cinder-quobyte-65f7e92a-4f82-49f8-80d0-32c60474f028" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Lock "cinder-quobyte-65f7e92a-4f82-49f8-80d0-32c60474f028" acquired by "delete_volume" :: waited 0.046s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:26 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bda65a3-9695-4fa6-81e5-0a4a12b30405]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-65f7e92a-4f82-49f8-80d0-32c60474f028 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:26 devstack sudo[100210]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.487s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:26 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:26 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Deleted volume successfully. Aug 09 12:51:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d67c8c8f-2abf-4313-95bc-8dc4fa76c716 tempest-VolumesTestJSON-1438328188 None] Lock "cinder-628361da-759b-4345-aec8-91f6bd3a2e14-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:26 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-65f7e92a-4f82-49f8-80d0-32c60474f028 Aug 09 12:51:26 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:27 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-65f7e92a-4f82-49f8-80d0-32c60474f028" returned: 0 in 1.313s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-65f7e92a-4f82-49f8-80d0-32c60474f028 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:27 devstack sudo[100227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-65f7e92a-4f82-49f8-80d0-32c60474f028 Aug 09 12:51:27 devstack sudo[100227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:27 devstack sudo[100227]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-65f7e92a-4f82-49f8-80d0-32c60474f028" returned: 0 in 0.579s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Lock "cinder-quobyte-65f7e92a-4f82-49f8-80d0-32c60474f028" released by "delete_volume" :: held 2.018s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:28 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Created reservations ['fbc7e459-da91-4109-acf7-b53e41b6f51a', '8b1d290e-a405-48cf-a549-8e22162d7219', '811baa39-10ab-4ef0-8568-906ab29890aa', '8a19d664-c6e0-4622-92c3-d9a53702fe6b'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:28 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:28 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:28 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.580s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:28 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:28 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Deleted volume successfully. Aug 09 12:51:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bea31b3d-9421-48ce-84c6-853b71c3d45b tempest-VolumesTestJSON-1438328188 None] Lock "cinder-65f7e92a-4f82-49f8-80d0-32c60474f028-delete_volume" released by "delete_volume" :: held 3.102s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:31 devstack sudo[100204]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a" returned: 0 in 6.296s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:31 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9, size 1024.00 MB, duration 6.30 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:51:31 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Converted 1024.00 MB image at 162.63 MB/s Aug 09 12:51:31 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a is being set with open permissions: ugo+rw Aug 09 12:51:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:31 devstack sudo[100234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a Aug 09 12:51:31 devstack sudo[100234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:31 devstack sudo[100234]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a" returned: 0 in 0.308s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-d3b1ff98-6fe3-4349-a537-eb02d59d136a" released by "_copy_volume_from_snapshot" :: held 7.584s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-47bfa014-9a85-4b64-8cde-d155d496e782-d3b1ff98-6fe3-4349-a537-eb02d59d136a" released by "_create_volume_from_snapshot" :: held 7.682s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.706s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fe80409-5288-4d95-9217-30010e274401) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a', 'volume_size': 1, 'snapshot_id': '47bfa014-9a85-4b64-8cde-d155d496e782'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cec8ea4-2484-463e-916f-2e02ccade6fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Flow 'volume_create_manager' (2ba3a5e6-e6e4-4234-b977-7da731c09a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85930973-1fdc-4682-b559-f504e14bfdc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:32 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Volume volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a (d3b1ff98-6fe3-4349-a537-eb02d59d136a): created successfully Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cec8ea4-2484-463e-916f-2e02ccade6fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Flow 'volume_create_manager' (f2d80952-0a75-4c7b-bd52-879f2814a7a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85930973-1fdc-4682-b559-f504e14bfdc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-368875973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a17f80-113c-4771-9f77-2e6f029d4736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdfceab11ed54b35be28210144ebcff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:32Z,use_quota=True,user_id='bf14578b2c6640fca509099f2e788ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39776757-8afc-406c-a04a-c72eaae55892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39776757-8afc-406c-a04a-c72eaae55892) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3368c706-b60b-488d-91ab-4c1756c9e6e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3368c706-b60b-488d-91ab-4c1756c9e6e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6a17f80-113c-4771-9f77-2e6f029d4736', 'volume_name': 'volume-c6a17f80-113c-4771-9f77-2e6f029d4736', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0d6f73-c1a3-4237-ad61-09ce1ba9f576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f0d6f73-c1a3-4237-ad61-09ce1ba9f576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603448a9-7ba4-4d11-94b1-e12fdac3ef45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:32 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Volume c6a17f80-113c-4771-9f77-2e6f029d4736: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6a17f80-113c-4771-9f77-2e6f029d4736', 'volume_size': 1} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-368875973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6a17f80-113c-4771-9f77-2e6f029d4736,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cdfceab11ed54b35be28210144ebcff0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:32Z,use_quota=True,user_id='bf14578b2c6640fca509099f2e788ca8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Creating volume c6a17f80-113c-4771-9f77-2e6f029d4736 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:51:32 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6a17f80-113c-4771-9f77-2e6f029d4736 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:32 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-bac051df-b545-4c3d-8348-e232096810eb tempest-VolumesSnapshotTestJSON-1187682763 None] Created volume successfully. Aug 09 12:51:32 devstack sudo[100237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6a17f80-113c-4771-9f77-2e6f029d4736 1073741824 Aug 09 12:51:32 devstack sudo[100237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-d3b1ff98-6fe3-4349-a537-eb02d59d136a-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-d3b1ff98-6fe3-4349-a537-eb02d59d136a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-d3b1ff98-6fe3-4349-a537-eb02d59d136a" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-d3b1ff98-6fe3-4349-a537-eb02d59d136a" acquired by "delete_volume" :: waited 0.029s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[760f4ce9-ca0e-431c-983b-66f732c37848]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:32 devstack sudo[100239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a Aug 09 12:51:32 devstack sudo[100239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:32 devstack sudo[100237]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6a17f80-113c-4771-9f77-2e6f029d4736 1073741824" returned: 0 in 0.546s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6a17f80-113c-4771-9f77-2e6f029d4736 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:32 devstack sudo[100247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6a17f80-113c-4771-9f77-2e6f029d4736 Aug 09 12:51:32 devstack sudo[100247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:33 devstack sudo[100239]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a" returned: 0 in 0.505s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:33 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a Aug 09 12:51:33 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:33 devstack sudo[100247]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6a17f80-113c-4771-9f77-2e6f029d4736" returned: 0 in 0.321s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.939s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (603448a9-7ba4-4d11-94b1-e12fdac3ef45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6a17f80-113c-4771-9f77-2e6f029d4736', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a472b6-f89f-412c-a0d1-40cac42e21ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:33 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Volume volume-c6a17f80-113c-4771-9f77-2e6f029d4736 (c6a17f80-113c-4771-9f77-2e6f029d4736): created successfully Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3a472b6-f89f-412c-a0d1-40cac42e21ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Flow 'volume_create_manager' (2ba3a5e6-e6e4-4234-b977-7da731c09a7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:33 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ac149c58-2dc5-4b75-a8a6-25932d78a801 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Created volume successfully. Aug 09 12:51:33 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3b1ff98-6fe3-4349-a537-eb02d59d136a" returned: 0 in 0.318s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-d3b1ff98-6fe3-4349-a537-eb02d59d136a" released by "delete_volume" :: held 0.884s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Created reservations ['117f81f7-87aa-4120-86c0-28b0447beb51', '8c7ba1ff-44ba-4c78-b530-2dcbae3830a0', '41971a42-217c-4f03-bfaf-5021c9100945', '92d9544d-6ca5-40b7-bdbb-0b9f6c15e58d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:33 devstack sudo[100254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:33 devstack sudo[100254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-47bfa014-9a85-4b64-8cde-d155d496e782-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-47bfa014-9a85-4b64-8cde-d155d496e782-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-47bfa014-9a85-4b64-8cde-d155d496e782" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-47bfa014-9a85-4b64-8cde-d155d496e782" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Deleting offline snapshot 47bfa014-9a85-4b64-8cde-d155d496e782 of volume c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] snapshot_file for this snap is: volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bb869e-43d0-490b-8b28-18d6ac81d438]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:33 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 Aug 09 12:51:33 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:33 devstack sudo[100254]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.427s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:33 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:33 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Deleted volume successfully. Aug 09 12:51:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-28cbb8b3-4343-4f2a-ba7c-1d735925a43f tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-d3b1ff98-6fe3-4349-a537-eb02d59d136a-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:34 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782" returned: 0 in 0.510s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:51:34 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca07311c-6303-4fbe-9f7e-840bd93576bc]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:34 devstack sudo[100262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 Aug 09 12:51:34 devstack sudo[100262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:34 devstack sudo[100262]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9" returned: 0 in 0.651s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:35 devstack sudo[100268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 Aug 09 12:51:35 devstack sudo[100268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:35 devstack sudo[100268]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782" returned: 0 in 0.479s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:35 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782 Aug 09 12:51:35 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:35 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-0a209357-1f32-4565-b82d-f1140676f6bc tempest-GroupSnapshotsTest-1099884862 None] Group tempest-GroupSnapshotsTest-Group-1829554440: creating Aug 09 12:51:35 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-0a209357-1f32-4565-b82d-f1140676f6bc tempest-GroupSnapshotsTest-1099884862 None] Group tempest-GroupSnapshotsTest-Group-1829554440: created successfully Aug 09 12:51:35 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-0a209357-1f32-4565-b82d-f1140676f6bc tempest-GroupSnapshotsTest-1099884862 None] Create group completed successfully. Aug 09 12:51:35 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9.47bfa014-9a85-4b64-8cde-d155d496e782" returned: 0 in 0.323s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-47bfa014-9a85-4b64-8cde-d155d496e782" released by "_delete_snapshot" :: held 2.150s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9" released by "delete_snapshot" :: held 2.188s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Acquiring lock "cinder-c6a17f80-113c-4771-9f77-2e6f029d4736-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Lock "cinder-c6a17f80-113c-4771-9f77-2e6f029d4736-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Acquiring lock "cinder-quobyte-c6a17f80-113c-4771-9f77-2e6f029d4736" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Created reservations ['2354d385-bd8f-43de-b0e5-9c1c0fa8a960', '6e899b39-a0c1-48ff-82d0-95481de92532', 'f677d398-0ad5-4f2a-8e63-eaf58869cf3a', '18388eae-ec10-4941-ba14-45b458fd160c'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Lock "cinder-quobyte-c6a17f80-113c-4771-9f77-2e6f029d4736" acquired by "delete_volume" :: waited 0.033s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79acecf-adb2-474e-a85d-0cfcb5327c4e]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6a17f80-113c-4771-9f77-2e6f029d4736 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:36 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Delete snapshot completed successfully. Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-92cc6cfb-b287-482c-884e-6ec9aa5ea507 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-47bfa014-9a85-4b64-8cde-d155d496e782-delete_snapshot" released by "delete_snapshot" :: held 2.469s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:36 devstack sudo[100278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6a17f80-113c-4771-9f77-2e6f029d4736 Aug 09 12:51:36 devstack sudo[100278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:36 devstack sudo[100278]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6a17f80-113c-4771-9f77-2e6f029d4736" returned: 0 in 0.399s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6a17f80-113c-4771-9f77-2e6f029d4736 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:36 devstack sudo[100283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6a17f80-113c-4771-9f77-2e6f029d4736 Aug 09 12:51:36 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:36 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6a17f80-113c-4771-9f77-2e6f029d4736" returned: 0 in 0.281s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Lock "cinder-quobyte-c6a17f80-113c-4771-9f77-2e6f029d4736" released by "delete_volume" :: held 0.735s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Created reservations ['f82c8254-37cc-412a-a896-6fd89717ec65', '82c3b377-a1f8-48c1-b362-8b7d3c68cfd6', '608131c7-5af9-4c0a-b928-b1cfa8b3e417', 'a5bb49f9-0d0a-421b-95df-ff93e89d47c7'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:37 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:37 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9" acquired by "delete_volume" :: waited 0.039s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[281b9353-ef55-46a5-8414-dce7d3587791]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:37 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.536s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:37 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Deleted volume successfully. Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8d39bad2-4ddb-4d2d-b712-ac4cb9da4de9 tempest-VolumeQuotasNegativeTestJSON-420576835 None] Lock "cinder-c6a17f80-113c-4771-9f77-2e6f029d4736-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:51:37 devstack sudo[100300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 Aug 09 12:51:37 devstack sudo[100300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Flow 'volume_create_manager' (b94e6d9e-d49b-4377-86ec-d9b0e36a1ab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43f06af-30c7-44fa-b0ee-a6aa53cbf271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e43f06af-30c7-44fa-b0ee-a6aa53cbf271) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-379593997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=138062e4-cb43-422e-9313-28c75af8d944,host='devstack@QuobyteHD#QuobyteHD',id=970f38dc-b86a-4ddf-995a-8242da5f80b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef954cd94fe4dd99255b96f4623b6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:38Z,use_quota=True,user_id='3000f724a1c441e7bf0210f85eccdbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c22ab9fd-8de3-4065-847d-2cf9604b0ada),volume_type_id=c22ab9fd-8de3-4065-847d-2cf9604b0ada)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f6844a-3ece-44d1-8777-5633bfc8db45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f6844a-3ece-44d1-8777-5633bfc8db45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bca8c6-4bd8-4770-b190-999139c59981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06bca8c6-4bd8-4770-b190-999139c59981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '970f38dc-b86a-4ddf-995a-8242da5f80b6', 'volume_name': 'volume-970f38dc-b86a-4ddf-995a-8242da5f80b6', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4fd234-07f1-42ea-bc0e-1798779b723a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f4fd234-07f1-42ea-bc0e-1798779b723a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe53fc6-86a2-463a-a194-6a9917cb9900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:37 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Volume 970f38dc-b86a-4ddf-995a-8242da5f80b6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-970f38dc-b86a-4ddf-995a-8242da5f80b6', 'volume_size': 1} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=138062e4-cb43-422e-9313-28c75af8d944,created_at=2026-08-09T10:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-379593997',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=138062e4-cb43-422e-9313-28c75af8d944,host='devstack@QuobyteHD#QuobyteHD',id=970f38dc-b86a-4ddf-995a-8242da5f80b6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef954cd94fe4dd99255b96f4623b6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:38Z,use_quota=True,user_id='3000f724a1c441e7bf0210f85eccdbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c22ab9fd-8de3-4065-847d-2cf9604b0ada),volume_type_id=c22ab9fd-8de3-4065-847d-2cf9604b0ada)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Creating volume 970f38dc-b86a-4ddf-995a-8242da5f80b6 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:51:37 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:51:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:37 devstack sudo[100325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 1073741824 Aug 09 12:51:37 devstack sudo[100325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:38 devstack sudo[100300]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9" returned: 0 in 0.694s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:38 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9 Aug 09 12:51:38 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:38 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9" returned: 0 in 0.360s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9" released by "delete_volume" :: held 1.203s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Created reservations ['5b5d3802-d13b-40f4-8558-1bf47861c40d', '5990301e-9288-4755-82e7-5ed657891c5b', '9925fbe5-2580-44a5-a6bb-383b2bf68cfe', '0609bfd7-7bd7-480c-8b35-b9d6b894d482'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:38 devstack sudo[100325]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 1073741824" returned: 0 in 0.712s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:38 devstack sudo[100342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:38 devstack sudo[100342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:38 devstack sudo[100344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:38 devstack sudo[100344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:39 devstack sudo[100342]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6" returned: 0 in 0.349s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbe53fc6-86a2-463a-a194-6a9917cb9900) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-970f38dc-b86a-4ddf-995a-8242da5f80b6', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03eb6f0f-3184-4ff6-8445-ab20cd3a7668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "cinder-quobyte-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:39 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Volume volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 (970f38dc-b86a-4ddf-995a-8242da5f80b6): created successfully Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03eb6f0f-3184-4ff6-8445-ab20cd3a7668) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Flow 'volume_create_manager' (b94e6d9e-d49b-4377-86ec-d9b0e36a1ab7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4" acquired by "delete_volume" :: waited 0.045s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:39 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-dfc3a806-9915-4520-a552-158145886da6 tempest-GroupSnapshotsTest-1099884862 None] Created volume successfully. Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7193af46-cf26-486c-aa51-5661ab8f8409]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:39 devstack sudo[100344]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.555s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:39 devstack sudo[100347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 Aug 09 12:51:39 devstack sudo[100347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:39 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Deleted volume successfully. Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-351ec6ed-ceee-4e11-a229-93ebf92acfe0 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-c97e7dc8-0fce-4c7a-b14f-72d1dbec41b9-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:39 devstack sudo[100347]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4" returned: 0 in 0.435s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:39 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4 Aug 09 12:51:39 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:39 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4" returned: 0 in 0.309s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:39 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-quobyte-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4" released by "delete_volume" :: held 0.815s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Created reservations ['b1edcfa7-7e5e-4dcf-bb34-679157d77e0e', '46e3a815-507d-41ce-88b8-e26978b7fe0a', '93c7a91a-7736-454c-ad4e-d96c14e4d54e', '04b1e66f-27e1-400f-b71d-4d78d7d27ea6'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:40 devstack sudo[100358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:40 devstack sudo[100358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:40 devstack sudo[100358]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.392s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:40 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Deleted volume successfully. Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aa980241-2bc4-420f-9056-afe70b0c1295 tempest-VolumesSnapshotTestJSON-1187682763 None] Lock "cinder-b6ecddf2-0573-4f11-93e9-8e8f0988b7d4-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:40 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] GroupSnapshot f2d57bba-870e-454d-9746-3569f73a3f3d: creating. Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] Group snapshot f2d57bba-870e-454d-9746-3569f73a3f3d: creating. {{(pid=89309) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] Creating offline snapshot 75292639-6e27-46c2-9277-f58deb39bacd of volume 970f38dc-b86a-4ddf-995a-8242da5f80b6 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fcba90e-e2e6-4cd4-9a5f-fb51b6ce9f6d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:41 devstack sudo[100361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 Aug 09 12:51:41 devstack sudo[100361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:41 devstack sudo[100361]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6" returned: 0 in 0.588s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:41 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd 1G Aug 09 12:51:41 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:42 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd 1G" returned: 0 in 0.586s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:42 devstack sudo[100372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd Aug 09 12:51:42 devstack sudo[100372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:42 devstack sudo[100372]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd" returned: 0 in 0.443s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:42 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:51:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:42 devstack sudo[100378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd Aug 09 12:51:42 devstack sudo[100378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:42 devstack sudo[100378]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd" returned: 0 in 0.327s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:42 devstack sudo[100381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.info Aug 09 12:51:42 devstack sudo[100381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:43 devstack sudo[100381]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.info" returned: 0 in 0.309s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:43 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.info is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:51:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:43 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.info Aug 09 12:51:43 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:43 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.info" returned: 0 in 0.282s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.649s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:43 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=145,cinder:UPDATE=189,cinder:DELETE=11,cinder:INSERT=40 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:51:43 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=180,cinder:INSERT=48,cinder:DELETE=16,cinder:SELECT=152 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:51:43 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-22857fce-c96b-4776-a0b9-b8aed802ab03 tempest-GroupSnapshotsTest-1099884862 None] group_snapshot f2d57bba-870e-454d-9746-3569f73a3f3d: created successfully Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-75292639-6e27-46c2-9277-f58deb39bacd-4bcf958c-8ae9-461d-8d32-6f057dd8e566" by "_create_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-75292639-6e27-46c2-9277-f58deb39bacd-4bcf958c-8ae9-461d-8d32-6f057dd8e566" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Creating volume 4bcf958c-8ae9-461d-8d32-6f057dd8e566 from snapshot 75292639-6e27-46c2-9277-f58deb39bacd {{(pid=89309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-4bcf958c-8ae9-461d-8d32-6f057dd8e566" by "_copy_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-4bcf958c-8ae9-461d-8d32-6f057dd8e566" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] snapshot: 75292639-6e27-46c2-9277-f58deb39bacd, volume: 4bcf958c-8ae9-461d-8d32-6f057dd8e566, {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[570386be-90b2-4e7d-bd0b-9377776255dd]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:45 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd Aug 09 12:51:45 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:45 devstack sudo[100387]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd" returned: 0 in 0.534s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970f38dc-b86a-4ddf-995a-8242da5f80b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:51:45 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaa31b6-6f34-447a-ac2e-1e725703f5e1]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:45 devstack sudo[100392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 Aug 09 12:51:45 devstack sudo[100392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:46 devstack sudo[100392]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6" returned: 0 in 0.544s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Creating direct copy from snapshot {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.utils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Path /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566 not found in is_blk_device check {{(pid=89309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:46 devstack sudo[100400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566 Aug 09 12:51:46 devstack sudo[100400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Flow 'volume_create_manager' (12781f06-2ce8-45c3-9a7c-3e2b26e911fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a933fc-1e4f-4048-84f3-6b220794a559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a933fc-1e4f-4048-84f3-6b220794a559) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-714340688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b230e51-71be-4313-9091-eb86297216a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c3fb701a5146a3b6cda932c3484d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:47Z,use_quota=True,user_id='1ae3f77c34db4d568415cbf8f21ec10c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c400267-d50d-4bca-8441-d66897799879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c400267-d50d-4bca-8441-d66897799879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27677c5f-e727-4966-a8eb-d1ec27c6b85e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27677c5f-e727-4966-a8eb-d1ec27c6b85e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b230e51-71be-4313-9091-eb86297216a2', 'volume_name': 'volume-9b230e51-71be-4313-9091-eb86297216a2', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bc2c58-fed1-4e4f-906b-263667ec5392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2bc2c58-fed1-4e4f-906b-263667ec5392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3e9853-f3db-49a8-8261-06428fbe85f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:46 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Volume 9b230e51-71be-4313-9091-eb86297216a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b230e51-71be-4313-9091-eb86297216a2', 'volume_size': 1} Aug 09 12:51:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:52 devstack sudo[100400]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566" returned: 0 in 6.633s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:52 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6, size 1024.00 MB, duration 6.64 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:51:52 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Converted 1024.00 MB image at 154.33 MB/s Aug 09 12:51:52 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566 is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:51:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:52 devstack sudo[100447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566 Aug 09 12:51:52 devstack sudo[100447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:53 devstack sudo[100447]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566" returned: 0 in 0.321s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-4bcf958c-8ae9-461d-8d32-6f057dd8e566" released by "_copy_volume_from_snapshot" :: held 8.166s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-75292639-6e27-46c2-9277-f58deb39bacd-4bcf958c-8ae9-461d-8d32-6f057dd8e566" released by "_create_volume_from_snapshot" :: held 8.303s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.326s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.410s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-714340688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b230e51-71be-4313-9091-eb86297216a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c3fb701a5146a3b6cda932c3484d77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:47Z,use_quota=True,user_id='1ae3f77c34db4d568415cbf8f21ec10c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Creating volume 9b230e51-71be-4313-9091-eb86297216a2 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:51:53 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:53 devstack sudo[100463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2 1073741824 Aug 09 12:51:53 devstack sudo[100463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:53 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-7c395436-9f61-4403-bc7b-179806867bb4 tempest-GroupSnapshotsTest-1099884862 None] Create group from source-snapshot-f2d57bba-870e-454d-9746-3569f73a3f3d completed successfully. Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Flow 'volume_create_manager' (ee12cab3-ff0c-452c-8d2c-6e487627e8da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5532b725-0d91-43e5-8dd5-0b86ecbcfda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5532b725-0d91-43e5-8dd5-0b86ecbcfda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1339920322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4bbe2827cdf4183b81f33403bfa1403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:53Z,use_quota=True,user_id='d4063a3063514c5fba0def0daa667f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d330df4-fd9f-4b76-b37d-ccab4293f327) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d330df4-fd9f-4b76-b37d-ccab4293f327) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c26b101-6b3d-4e69-9326-22c8298ec8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c26b101-6b3d-4e69-9326-22c8298ec8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06', 'volume_name': 'volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06', 'volume_size': 2}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a027b46e-9dbe-4145-884e-2a92e28cb2e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a027b46e-9dbe-4145-884e-2a92e28cb2e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb58063-8739-4da8-ba6a-b4f7737163c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:53 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Volume 1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06', 'volume_size': 2} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:53 devstack sudo[100463]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2 1073741824" returned: 0 in 0.601s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:53 devstack sudo[100471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2 Aug 09 12:51:53 devstack sudo[100471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:54 devstack sudo[100471]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2" returned: 0 in 0.361s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.640s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1339920322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4bbe2827cdf4183b81f33403bfa1403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:53Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:53Z,use_quota=True,user_id='d4063a3063514c5fba0def0daa667f99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Creating volume 1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:51:54 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 2147483648 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d3e9853-f3db-49a8-8261-06428fbe85f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b230e51-71be-4313-9091-eb86297216a2', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:54 devstack sudo[100489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 2147483648 Aug 09 12:51:54 devstack sudo[100489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc4a835-7b4c-44b6-b909-53850bd919e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-4bcf958c-8ae9-461d-8d32-6f057dd8e566" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:54 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Volume volume-9b230e51-71be-4313-9091-eb86297216a2 (9b230e51-71be-4313-9091-eb86297216a2): created successfully Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dfc4a835-7b4c-44b6-b909-53850bd919e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Flow 'volume_create_manager' (12781f06-2ce8-45c3-9a7c-3e2b26e911fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-4bcf958c-8ae9-461d-8d32-6f057dd8e566" acquired by "delete_volume" :: waited 0.132s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:54 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d13b1c31-84bb-4584-b1db-577e492386c4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Created volume successfully. Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ede20e2e-f3fa-466b-bdb7-b2b25a750b4d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:54 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566 Aug 09 12:51:54 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:55 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566" returned: 0 in 0.797s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:55 devstack sudo[100544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566 Aug 09 12:51:55 devstack sudo[100544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:55 devstack sudo[100489]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 2147483648" returned: 0 in 1.179s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:55 devstack sudo[100552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 Aug 09 12:51:55 devstack sudo[100552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:55 devstack sudo[100544]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4bcf958c-8ae9-461d-8d32-6f057dd8e566" returned: 0 in 0.336s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-4bcf958c-8ae9-461d-8d32-6f057dd8e566" released by "delete_volume" :: held 1.228s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Created reservations ['2d889e63-e415-49db-92ec-e9057490ce28'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:55 devstack cinder-volume[89309]: WARNING cinder.quota [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-75462878 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-75462878, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:51:55 devstack sudo[100552]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:55 devstack cinder-volume[89309]: WARNING cinder.quota [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-75462878 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-75462878, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06" returned: 0 in 0.297s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.592s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Creating offline snapshot dd69ec4f-18a0-4154-b903-ff1025a815df of volume 9b230e51-71be-4313-9091-eb86297216a2 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1eb58063-8739-4da8-ba6a-b4f7737163c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06', 'volume_size': 2}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d67bc3-6408-468a-95b9-339963d571f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea46abd-43e8-455a-b3ca-68fdb94cfd3e]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Created reservations ['8e6d1170-bba0-4045-9de8-ce9770b7c743', '469b4f90-5b95-484e-b547-1c2d0a548711', 'c0cf1ac8-7114-4ee4-8fc4-4048d2443fce', '7ef06018-d6cb-4979-a996-51ec7f7aab36'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:55 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Volume volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 (1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06): created successfully Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32d67bc3-6408-468a-95b9-339963d571f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Flow 'volume_create_manager' (ee12cab3-ff0c-452c-8d2c-6e487627e8da) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:55 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-15b8a6e5-f19a-4806-8d2a-ec57ba003176 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Created volume successfully. Aug 09 12:51:55 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2 Aug 09 12:51:55 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:56 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:56 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:56 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2" returned: 0 in 0.467s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:56 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.316s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:56 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:56 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1ab6f138-cd97-444f-86c2-38a512e9c596 tempest-GroupSnapshotsTest-1099884862 None] Delete group completed successfully. Aug 09 12:51:56 devstack sudo[100582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df 1G Aug 09 12:51:56 devstack sudo[100582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:56 devstack sudo[100582]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df 1G" returned: 0 in 0.454s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b230e51-71be-4313-9091-eb86297216a2 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:56 devstack sudo[100588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b230e51-71be-4313-9091-eb86297216a2 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df Aug 09 12:51:56 devstack sudo[100588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:57 devstack sudo[100588]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b230e51-71be-4313-9091-eb86297216a2 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df" returned: 0 in 0.432s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:57 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df is being set with open permissions: ugo+rw Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:57 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] group_snapshot f2d57bba-870e-454d-9746-3569f73a3f3d: deleting Aug 09 12:51:57 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df Aug 09 12:51:57 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] group_snapshot f2d57bba-870e-454d-9746-3569f73a3f3d: deleting {{(pid=89309) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-970f38dc-b86a-4ddf-995a-8242da5f80b6" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-970f38dc-b86a-4ddf-995a-8242da5f80b6" acquired by "delete_snapshot" :: waited 0.032s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-75292639-6e27-46c2-9277-f58deb39bacd" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-75292639-6e27-46c2-9277-f58deb39bacd" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Deleting offline snapshot 75292639-6e27-46c2-9277-f58deb39bacd of volume 970f38dc-b86a-4ddf-995a-8242da5f80b6 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] snapshot_file for this snap is: volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[32973bd1-0c71-48a6-a55a-f6656ff57520]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:57 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd Aug 09 12:51:57 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:57 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df" returned: 0 in 0.444s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:57 devstack sudo[100600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:51:57 devstack sudo[100600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:57 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.info Aug 09 12:51:57 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:57 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd" returned: 0 in 0.557s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-970f38dc-b86a-4ddf-995a-8242da5f80b6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:51:57 devstack sudo[100600]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.368s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[32fca2ab-76e4-413f-83d5-9620c0f928d4]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:58 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.info" returned: 0 in 0.396s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:58 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.info is being set with open permissions: ugo+rw Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:58 devstack sudo[100610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.info Aug 09 12:51:58 devstack sudo[100610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:58 devstack sudo[100609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 Aug 09 12:51:58 devstack sudo[100609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:58 devstack sudo[100610]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.info" returned: 0 in 0.345s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.700s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.455s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Creating offline snapshot 98382b84-c434-4d96-b3c6-535fd660ec95 of volume 1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:51:58 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4e1e95d6-119e-4b2c-8411-f31a0802c343 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Create snapshot completed successfully Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[61860d77-7b7e-4854-9e10-c5ee3bcd9873]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:58 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 Aug 09 12:51:58 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:58 devstack sudo[100609]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6" returned: 0 in 0.709s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:58 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd Aug 09 12:51:58 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:58 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06" returned: 0 in 0.453s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 2G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:59 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 2G Aug 09 12:51:59 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:59 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd" returned: 0 in 0.542s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:59 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd Aug 09 12:51:59 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Flow 'volume_create_manager' (a9903d9f-2716-40bf-a1a0-7dfd80add081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a63f4b5-dbda-497a-b831-a5b8f65d3a0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a63f4b5-dbda-497a-b831-a5b8f65d3a0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1535653119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546121f5-a2db-4371-b3ca-0602588e1af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa10c65a267a4002adc5aa06c8f01073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:59Z,use_quota=True,user_id='acc1a495608e4dc6b2829003b3dd6346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7e9d31-1d1d-4822-a557-69374602ebea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7e9d31-1d1d-4822-a557-69374602ebea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30e6898-4ffc-4b1a-a898-8635961b36b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a30e6898-4ffc-4b1a-a898-8635961b36b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '546121f5-a2db-4371-b3ca-0602588e1af6', 'volume_name': 'volume-546121f5-a2db-4371-b3ca-0602588e1af6', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3192c908-5fd8-4ac8-bdd6-fec61dcd987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3192c908-5fd8-4ac8-bdd6-fec61dcd987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878ef7a5-ad13-4c07-a8aa-aea74d82258a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:51:59 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Volume 546121f5-a2db-4371-b3ca-0602588e1af6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-546121f5-a2db-4371-b3ca-0602588e1af6', 'volume_size': 1} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:51:59 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 2G" returned: 0 in 0.687s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:51:59 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Aug 09 12:51:59 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 Aug 09 12:51:59 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6.75292639-6e27-46c2-9277-f58deb39bacd" returned: 0 in 0.435s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-75292639-6e27-46c2-9277-f58deb39bacd" released by "_delete_snapshot" :: held 2.437s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-970f38dc-b86a-4ddf-995a-8242da5f80b6" released by "delete_snapshot" :: held 2.475s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:51:59 devstack cinder-volume[89309]: WARNING cinder.quota [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-75462878 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-75462878, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:51:59 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] Created reservations ['79602370-10bc-40cd-9dec-c2ffc6325916', '27ded08d-3c1b-476e-8af5-86cdb7a2906d', '84f0c4ee-7b40-43f3-9fc5-d78c46c1c450', '87cd1361-b4d7-49d8-9343-52ca96d051b2'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:51:59 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8618aaa1-791e-4ed7-a2b7-04c4c1f8d431 tempest-GroupSnapshotsTest-1099884862 None] group_snapshot f2d57bba-870e-454d-9746-3569f73a3f3d: deleted successfully Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Acquiring lock "cinder-dd69ec4f-18a0-4154-b903-ff1025a815df-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "cinder-dd69ec4f-18a0-4154-b903-ff1025a815df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Acquiring lock "cinder-quobyte-9b230e51-71be-4313-9091-eb86297216a2" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:00 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "cinder-quobyte-9b230e51-71be-4313-9091-eb86297216a2" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Acquiring lock "cinder-quobyte-dd69ec4f-18a0-4154-b903-ff1025a815df" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95" returned: 0 in 0.432s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:00 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 is being set with open permissions: ugo+rw Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "cinder-quobyte-dd69ec4f-18a0-4154-b903-ff1025a815df" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Deleting offline snapshot dd69ec4f-18a0-4154-b903-ff1025a815df of volume 9b230e51-71be-4313-9091-eb86297216a2 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:52:00 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 Aug 09 12:52:00 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] snapshot_file for this snap is: volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e1049a8-d83e-47fb-87cd-15cac1441c04]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:00 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df Aug 09 12:52:00 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:00 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95" returned: 0 in 0.282s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:00 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.info Aug 09 12:52:00 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:00 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df" returned: 0 in 0.407s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b230e51-71be-4313-9091-eb86297216a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e7d055-65cc-47a5-a977-6491188d23f3]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:00 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.info" returned: 0 in 0.291s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:00 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.info is being set with open permissions: ugo+rw Aug 09 12:52:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:00 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2 Aug 09 12:52:00 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:00 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.info Aug 09 12:52:00 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:00 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.info" returned: 0 in 0.281s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:01 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.565s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.603s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1535653119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=546121f5-a2db-4371-b3ca-0602588e1af6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa10c65a267a4002adc5aa06c8f01073',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:51:59Z,use_quota=True,user_id='acc1a495608e4dc6b2829003b3dd6346',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Creating volume 546121f5-a2db-4371-b3ca-0602588e1af6 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:52:01 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-546121f5-a2db-4371-b3ca-0602588e1af6 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:01 devstack sudo[100661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-546121f5-a2db-4371-b3ca-0602588e1af6 1073741824 Aug 09 12:52:01 devstack sudo[100661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2" returned: 0 in 0.503s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:01 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df Aug 09 12:52:01 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:01 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-9d6c70f1-1560-4b0b-895b-f64ccfc6afd5 tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Create snapshot completed successfully Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-970f38dc-b86a-4ddf-995a-8242da5f80b6" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-970f38dc-b86a-4ddf-995a-8242da5f80b6" acquired by "delete_volume" :: waited 0.040s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0afb900-9107-49aa-8c0b-2e2cecee6a99]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:01 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 Aug 09 12:52:01 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Acquiring lock "cinder-98382b84-c434-4d96-b3c6-535fd660ec95-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "cinder-98382b84-c434-4d96-b3c6-535fd660ec95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Acquiring lock "cinder-quobyte-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "cinder-quobyte-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06" acquired by "delete_snapshot" :: waited 0.044s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Acquiring lock "cinder-quobyte-98382b84-c434-4d96-b3c6-535fd660ec95" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:01 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "cinder-quobyte-98382b84-c434-4d96-b3c6-535fd660ec95" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Deleting offline snapshot 98382b84-c434-4d96-b3c6-535fd660ec95 of volume 1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] snapshot_file for this snap is: volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df" returned: 0 in 0.602s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d1a1705-b4c3-4a50-aff5-9a577f540ccb]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:01 devstack sudo[100675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df Aug 09 12:52:01 devstack sudo[100675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:01 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 Aug 09 12:52:01 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:01 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6" returned: 0 in 0.571s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:01 devstack sudo[100683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6 Aug 09 12:52:01 devstack sudo[100683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:01 devstack sudo[100661]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-546121f5-a2db-4371-b3ca-0602588e1af6 1073741824" returned: 0 in 0.886s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-546121f5-a2db-4371-b3ca-0602588e1af6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:02 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-546121f5-a2db-4371-b3ca-0602588e1af6 Aug 09 12:52:02 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:02 devstack sudo[100675]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2.dd69ec4f-18a0-4154-b903-ff1025a815df" returned: 0 in 0.459s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:02 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95" returned: 0 in 0.506s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "cinder-quobyte-dd69ec4f-18a0-4154-b903-ff1025a815df" released by "_delete_snapshot" :: held 2.151s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[39f384d6-a04c-43c2-a3e3-fd48abec4249]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "cinder-quobyte-9b230e51-71be-4313-9091-eb86297216a2" released by "delete_snapshot" :: held 2.215s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:02 devstack sudo[100683]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-970f38dc-b86a-4ddf-995a-8242da5f80b6" returned: 0 in 0.476s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:02 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-546121f5-a2db-4371-b3ca-0602588e1af6" returned: 0 in 0.363s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.333s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-970f38dc-b86a-4ddf-995a-8242da5f80b6" released by "delete_volume" :: held 1.154s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (878ef7a5-ad13-4c07-a8aa-aea74d82258a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-546121f5-a2db-4371-b3ca-0602588e1af6', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88aa1e71-86ee-4324-b035-4f36a3c4fb15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:02 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Volume volume-546121f5-a2db-4371-b3ca-0602588e1af6 (546121f5-a2db-4371-b3ca-0602588e1af6): created successfully Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88aa1e71-86ee-4324-b035-4f36a3c4fb15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Flow 'volume_create_manager' (a9903d9f-2716-40bf-a1a0-7dfd80add081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:02 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8844dbb6-d9e2-4d28-a742-bcac96d74d32 tempest-TestMinimumBasicScenario-99153121 None] Created volume successfully. Aug 09 12:52:02 devstack sudo[100692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 Aug 09 12:52:02 devstack sudo[100692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Created reservations ['9bdf44c4-a79d-4baf-9521-7560bdef3642', '23a471e7-2557-4880-92a3-d719fc41d3b1', '467ede53-9aac-4270-b13f-2e1a4766cb5b', '39005e41-e32b-4a8e-84e1-d0723f63fe31'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Created reservations ['f5039436-a432-4440-a926-af73b5b3e9a9'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:02 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Delete snapshot completed successfully. Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d07f6c1d-5205-4db3-aaa3-c3c34fd7314e tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "cinder-dd69ec4f-18a0-4154-b903-ff1025a815df-delete_snapshot" released by "delete_snapshot" :: held 2.575s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:02 devstack cinder-volume[89309]: WARNING cinder.db.api [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-75462878'] Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Created reservations ['adac8751-815a-4053-89e3-7c48fed2db78', '42e299a6-9ee0-4462-b3a8-f3e314091599', '251d5ab9-131b-4d66-bfe1-0a29961c22f4', 'aee8eb96-65c7-4258-abd6-bfd55a9fd9f5'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:02 devstack sudo[100698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:52:02 devstack sudo[100698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:02 devstack sudo[100692]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06" returned: 0 in 0.542s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:02 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 Aug 09 12:52:02 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:03 devstack sudo[100698]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.264s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:52:03 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-499b9844-6b10-4057-b62d-a7f92ce9cf51 tempest-GroupSnapshotsTest-1099884862 None] Delete group completed successfully. Aug 09 12:52:03 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95" returned: 0 in 0.352s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:03 devstack sudo[100706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95 Aug 09 12:52:03 devstack sudo[100706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Acquiring lock "cinder-9b230e51-71be-4313-9091-eb86297216a2-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "cinder-9b230e51-71be-4313-9091-eb86297216a2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Acquiring lock "cinder-quobyte-9b230e51-71be-4313-9091-eb86297216a2" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "cinder-quobyte-9b230e51-71be-4313-9091-eb86297216a2" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:03 devstack sudo[100706]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06.98382b84-c434-4d96-b3c6-535fd660ec95" returned: 0 in 0.342s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5278332-121f-4e83-b5c8-ca4373ac1eb7]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "cinder-quobyte-98382b84-c434-4d96-b3c6-535fd660ec95" released by "_delete_snapshot" :: held 1.913s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "cinder-quobyte-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06" released by "delete_snapshot" :: held 1.963s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:03 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2 Aug 09 12:52:03 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Created reservations ['9ce2d50e-74d0-4b83-8774-c4455112bedb', 'c3045ed0-1ef9-44ce-846a-59b4863859ae', 'ad30c217-4ecb-4f6b-9138-e524b12eb7dd', '8d81ecd7-bf76-4e03-91a7-b8ef34531436'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:03 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Delete snapshot completed successfully. Aug 09 12:52:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf23112-b8dd-44e1-997b-e8ad22a0c70f tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "cinder-98382b84-c434-4d96-b3c6-535fd660ec95-delete_snapshot" released by "delete_snapshot" :: held 2.322s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:04 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2" returned: 0 in 0.638s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:04 devstack sudo[100717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2 Aug 09 12:52:04 devstack sudo[100717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:04 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ec08a794-c5d6-4986-82b6-98ee7badb862 tempest-GroupSnapshotsTest-1099884862 None] Group tempest-GroupSnapshotsTest-Group-16293091: creating Aug 09 12:52:04 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ec08a794-c5d6-4986-82b6-98ee7badb862 tempest-GroupSnapshotsTest-1099884862 None] Group tempest-GroupSnapshotsTest-Group-16293091: created successfully Aug 09 12:52:04 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ec08a794-c5d6-4986-82b6-98ee7badb862 tempest-GroupSnapshotsTest-1099884862 None] Create group completed successfully. Aug 09 12:52:04 devstack sudo[100717]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b230e51-71be-4313-9091-eb86297216a2" returned: 0 in 0.333s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "cinder-quobyte-9b230e51-71be-4313-9091-eb86297216a2" released by "delete_volume" :: held 1.094s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Created reservations ['da9516ea-3268-4394-8dca-e2fe1a058703', '6712e15f-10d2-41fa-b564-9207e1a01eca', '9e436a2a-34fa-47ce-bbdb-56e08f67fb59', 'bc2e78ba-8099-4071-9317-4a1da062f5dc'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:04 devstack sudo[100727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:52:04 devstack sudo[100727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Acquiring lock "cinder-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-a71a132a-4366-476e-b4b1-488487689970 req-8d696826-3ef1-4698-a293-634725114d61 tempest-TestMinimumBasicScenario-99153121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-a71a132a-4366-476e-b4b1-488487689970 req-8d696826-3ef1-4698-a293-634725114d61 tempest-TestMinimumBasicScenario-99153121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "cinder-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-a71a132a-4366-476e-b4b1-488487689970 req-8d696826-3ef1-4698-a293-634725114d61 tempest-TestMinimumBasicScenario-99153121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Acquiring lock "cinder-quobyte-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-a71a132a-4366-476e-b4b1-488487689970 req-8d696826-3ef1-4698-a293-634725114d61 tempest-TestMinimumBasicScenario-99153121 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-546121f5-a2db-4371-b3ca-0602588e1af6', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac40da95-4e42-41a3-bbdb-5cc39dcf2d0b', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:52:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "cinder-quobyte-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06" acquired by "delete_volume" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:05 devstack sudo[100727]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.386s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:05 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:52:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Deleted volume successfully. Aug 09 12:52:05 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5490e919-cd3a-4c01-9872-424784b62a92]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6b3dc4a1-ecce-4103-9b3d-f633cede44d4 tempest-VolumeSnapshotQuotasNegativeTestJSON-1252431700 None] Lock "cinder-9b230e51-71be-4313-9091-eb86297216a2-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-a71a132a-4366-476e-b4b1-488487689970 req-8d696826-3ef1-4698-a293-634725114d61 tempest-TestMinimumBasicScenario-99153121 None] attachment_update completed successfully. Aug 09 12:52:05 devstack sudo[100731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 Aug 09 12:52:05 devstack sudo[100731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:05 devstack sudo[100731]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06" returned: 0 in 0.482s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:05 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06 Aug 09 12:52:05 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:05 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06" returned: 0 in 0.368s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "cinder-quobyte-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06" released by "delete_volume" :: held 0.936s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Created reservations ['18601a53-a163-488a-b639-2d6de895b185', 'b53bf487-0785-4143-a418-d5d168d35185', '38604f05-6094-4ecf-a0bb-f883dc1a1b03', '1ac72969-4d09-4956-b2e8-27eb14797a1d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:52:06 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:52:06 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Flow 'volume_create_manager' (e453a6e5-f759-46de-96ed-33cc2e91b8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82bfd8d-455f-4346-9dc8-b22e6fdeee02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82bfd8d-455f-4346-9dc8-b22e6fdeee02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391471264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00b466d0-012b-4824-a707-80e63b48944c,host='devstack@QuobyteHD#QuobyteHD',id=affa6cc9-36f6-4f27-a8ef-a3d26e6e0569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef954cd94fe4dd99255b96f4623b6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:06Z,use_quota=True,user_id='3000f724a1c441e7bf0210f85eccdbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f0fdd4d-d907-48be-baa7-1fa7ac0341ca),volume_type_id=1f0fdd4d-d907-48be-baa7-1fa7ac0341ca)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100d9401-35c5-4828-9924-407fd58cd32e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (100d9401-35c5-4828-9924-407fd58cd32e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6adc6d1-1b3b-4457-a213-c05a6953ce56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6adc6d1-1b3b-4457-a213-c05a6953ce56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'affa6cc9-36f6-4f27-a8ef-a3d26e6e0569', 'volume_name': 'volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e945ec8-5fa7-4a94-bde9-1110e4a32283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e945ec8-5fa7-4a94-bde9-1110e4a32283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b16ecd9-1cec-4386-8841-fc5868836f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:06 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Volume affa6cc9-36f6-4f27-a8ef-a3d26e6e0569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569', 'volume_size': 1} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=00b466d0-012b-4824-a707-80e63b48944c,created_at=2026-08-09T10:52:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-391471264',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00b466d0-012b-4824-a707-80e63b48944c,host='devstack@QuobyteHD#QuobyteHD',id=affa6cc9-36f6-4f27-a8ef-a3d26e6e0569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef954cd94fe4dd99255b96f4623b6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:06Z,use_quota=True,user_id='3000f724a1c441e7bf0210f85eccdbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f0fdd4d-d907-48be-baa7-1fa7ac0341ca),volume_type_id=1f0fdd4d-d907-48be-baa7-1fa7ac0341ca)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Creating volume affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:52:06 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:06 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 1073741824 Aug 09 12:52:06 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:06 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.650s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:06 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:52:07 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Deleted volume successfully. Aug 09 12:52:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1e6fb03b-fc1f-4991-a1d8-396ec0e3a8dd tempest-VolumesSnapshotNegativeTestJSON-1189222215 None] Lock "cinder-1f1dafcc-ee7f-4dbb-bd99-a22014dbfb06-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:07 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 1073741824" returned: 0 in 0.833s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:07 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 Aug 09 12:52:07 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:08 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569" returned: 0 in 0.507s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] <== create_volume: return (1409ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:52:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.416s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b16ecd9-1cec-4386-8841-fc5868836f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4cf7d8a-fa5c-45e4-85d5-0d2cb5e384ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:08 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Volume volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 (affa6cc9-36f6-4f27-a8ef-a3d26e6e0569): created successfully Aug 09 12:52:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4cf7d8a-fa5c-45e4-85d5-0d2cb5e384ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Flow 'volume_create_manager' (e453a6e5-f759-46de-96ed-33cc2e91b8de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:08 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d96c9f88-da20-4a51-a78c-8e05a86d462c tempest-GroupSnapshotsTest-1099884862 None] Created volume successfully. Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Flow 'volume_create_manager' (3184ec5b-c8e8-4ee4-871b-46b12a2e3d4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9295cdad-a945-4a71-b8ab-124fb8ca2ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9295cdad-a945-4a71-b8ab-124fb8ca2ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1579673265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00b466d0-012b-4824-a707-80e63b48944c,host='devstack@QuobyteHD#QuobyteHD',id=695821e0-7534-46d6-b5ef-7d65a52ce2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef954cd94fe4dd99255b96f4623b6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:10Z,use_quota=True,user_id='3000f724a1c441e7bf0210f85eccdbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f0fdd4d-d907-48be-baa7-1fa7ac0341ca),volume_type_id=1f0fdd4d-d907-48be-baa7-1fa7ac0341ca)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05065cb-12c8-4159-a005-c5d9b5ac8a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c05065cb-12c8-4159-a005-c5d9b5ac8a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2063e5a2-4861-4549-9b13-9cf556ec12e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2063e5a2-4861-4549-9b13-9cf556ec12e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '695821e0-7534-46d6-b5ef-7d65a52ce2d5', 'volume_name': 'volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8979dee7-9728-40b2-8595-ca164791bd62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8979dee7-9728-40b2-8595-ca164791bd62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa6343a-30d6-4f30-a3a1-5dfa9a65e01e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:10 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Volume 695821e0-7534-46d6-b5ef-7d65a52ce2d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5', 'volume_size': 1} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=00b466d0-012b-4824-a707-80e63b48944c,created_at=2026-08-09T10:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1579673265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=00b466d0-012b-4824-a707-80e63b48944c,host='devstack@QuobyteHD#QuobyteHD',id=695821e0-7534-46d6-b5ef-7d65a52ce2d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef954cd94fe4dd99255b96f4623b6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:10Z,use_quota=True,user_id='3000f724a1c441e7bf0210f85eccdbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1f0fdd4d-d907-48be-baa7-1fa7ac0341ca),volume_type_id=1f0fdd4d-d907-48be-baa7-1fa7ac0341ca)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Creating volume 695821e0-7534-46d6-b5ef-7d65a52ce2d5 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:52:10 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:10 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 1073741824 Aug 09 12:52:10 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:10 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 1073741824" returned: 0 in 0.595s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:11 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 Aug 09 12:52:11 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:11 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5" returned: 0 in 0.308s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] <== create_volume: return (959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:52:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.963s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fa6343a-30d6-4f30-a3a1-5dfa9a65e01e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fddb208a-60ad-49b7-8d99-1f5bbc1cb26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:11 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Volume volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 (695821e0-7534-46d6-b5ef-7d65a52ce2d5): created successfully Aug 09 12:52:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fddb208a-60ad-49b7-8d99-1f5bbc1cb26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Flow 'volume_create_manager' (3184ec5b-c8e8-4ee4-871b-46b12a2e3d4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-bc39f30e-b8c3-4cae-a312-2d107f985f20 tempest-GroupSnapshotsTest-1099884862 None] Created volume successfully. Aug 09 12:52:12 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-615869e5-9d9f-4530-8d17-2490e779f613 tempest-GroupSnapshotsTest-1099884862 None] Update group completed successfully. Aug 09 12:52:14 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-64eb2b06-9f8f-478e-a22d-22834fb022ea tempest-GroupSnapshotsTest-1099884862 None] Update group completed successfully. Aug 09 12:52:15 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f31dfee7-da7c-4af6-a8c1-e171c695a373 tempest-GroupSnapshotsTest-1099884862 None] Update group completed successfully. Aug 09 12:52:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c4ba9193-f59c-4912-94b7-0f3661b2d9b4 tempest-GroupSnapshotsTest-1099884862 None] Update group completed successfully. Aug 09 12:52:18 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] GroupSnapshot 14b49eb0-3310-45d4-97af-1a90f8accb20: creating. Aug 09 12:52:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Group snapshot 14b49eb0-3310-45d4-97af-1a90f8accb20: creating. {{(pid=89309) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 09 12:52:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Creating offline snapshot 3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce of volume affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:52:18 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[082a363d-d333-4b04-800b-443a46d2ef06]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:18 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 Aug 09 12:52:18 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:19 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569" returned: 0 in 0.645s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:19 devstack sudo[101179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce 1G Aug 09 12:52:19 devstack sudo[101179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:19 devstack sudo[101179]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce 1G" returned: 0 in 0.541s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:19 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce Aug 09 12:52:19 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:20 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce" returned: 0 in 0.361s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:20 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:52:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:20 devstack sudo[101193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce Aug 09 12:52:20 devstack sudo[101193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:20 devstack sudo[101193]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce" returned: 0 in 0.349s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:20 devstack sudo[101198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.info Aug 09 12:52:20 devstack sudo[101198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:20 devstack sudo[101198]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.info" returned: 0 in 0.443s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:20 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.info is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:52:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:20 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.info Aug 09 12:52:20 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:21 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.info" returned: 0 in 0.344s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.825s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Creating offline snapshot dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb of volume 695821e0-7534-46d6-b5ef-7d65a52ce2d5 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:52:21 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef2e8f18-8576-42a5-9be7-2a8b6d88acd1]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:21 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 Aug 09 12:52:21 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:21 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5" returned: 0 in 0.475s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:21 devstack sudo[101209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb 1G Aug 09 12:52:21 devstack sudo[101209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:22 devstack sudo[101209]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb 1G" returned: 0 in 0.647s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:22 devstack sudo[101216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb Aug 09 12:52:22 devstack sudo[101216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:22 devstack sudo[101216]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb" returned: 0 in 0.401s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:22 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:52:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:22 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb Aug 09 12:52:22 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:23 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb" returned: 0 in 0.334s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:23 devstack sudo[101226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.info Aug 09 12:52:23 devstack sudo[101226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:23 devstack sudo[101226]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.info" returned: 0 in 0.374s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:23 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.info is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:52:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:23 devstack sudo[101229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.info Aug 09 12:52:23 devstack sudo[101229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:23 devstack sudo[101229]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.info" returned: 0 in 0.279s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.660s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:24 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5d27175c-ac19-4449-8a94-d076cdf3d424 tempest-GroupSnapshotsTest-1099884862 None] group_snapshot 14b49eb0-3310-45d4-97af-1a90f8accb20: created successfully Aug 09 12:52:25 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] group_snapshot 14b49eb0-3310-45d4-97af-1a90f8accb20: deleting Aug 09 12:52:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] group_snapshot 14b49eb0-3310-45d4-97af-1a90f8accb20: deleting {{(pid=89309) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 09 12:52:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Deleting offline snapshot 3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce of volume affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:52:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] snapshot_file for this snap is: volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:52:25 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5392ca1b-04a3-4a48-9c39-96f58be0b302]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:25 devstack sudo[101247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce Aug 09 12:52:25 devstack sudo[101247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:25 devstack sudo[101247]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce" returned: 0 in 0.513s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:52:25 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[718b17c7-9190-42e9-9a62-70a102a1c929]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:25 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 Aug 09 12:52:25 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:26 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569" returned: 0 in 0.446s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:26 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce Aug 09 12:52:26 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:26 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce" returned: 0 in 0.537s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:26 devstack sudo[101317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce Aug 09 12:52:26 devstack sudo[101317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:27 devstack sudo[101317]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569.3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce" returned: 0 in 0.352s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-3b28d9da-1cdc-47be-bac4-2dcd3fb1f2ce" released by "_delete_snapshot" :: held 2.017s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569" released by "delete_snapshot" :: held 2.057s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-695821e0-7534-46d6-b5ef-7d65a52ce2d5" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-695821e0-7534-46d6-b5ef-7d65a52ce2d5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Deleting offline snapshot dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb of volume 695821e0-7534-46d6-b5ef-7d65a52ce2d5 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:52:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] snapshot_file for this snap is: volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:52:27 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0defd26-f883-44fa-a8e1-1e3675c586d5]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:27 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb Aug 09 12:52:27 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:28 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb" returned: 0 in 0.801s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:52:28 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c4dd487-ce6b-4899-be3e-6ad6e53a9d64]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:28 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 Aug 09 12:52:28 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:28 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5" returned: 0 in 0.483s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:28 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb Aug 09 12:52:28 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:29 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb" returned: 0 in 0.546s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:29 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb Aug 09 12:52:29 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:29 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5.dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb" returned: 0 in 0.412s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-dbbcb3d8-0472-477b-a3b7-3f6995dbd7eb" released by "_delete_snapshot" :: held 2.404s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-695821e0-7534-46d6-b5ef-7d65a52ce2d5" released by "delete_snapshot" :: held 2.444s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:29 devstack cinder-volume[89309]: WARNING cinder.quota [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-147904485 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-147904485, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:52:29 devstack cinder-volume[89309]: WARNING cinder.quota [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-147904485 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-147904485, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:52:29 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Created reservations ['e5428033-7dc9-4381-8fae-50ba9976bace', 'decb28ec-362e-4a3c-aa49-e0e152c08f61', 'f0a89873-37fc-45b0-b194-62bdd780678b', '86c21704-4a4d-4f1e-8244-c340d9b1127d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:29 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] Created reservations ['aac5147c-bb3b-4947-9d8e-042b447209a3', '35917c59-9b82-49e2-ae55-3cfa77c6eaf6', 'f560b3b4-c5a2-43de-aa7a-dc9e5457115b', '4c04efcf-9dad-4943-b6b1-91d61f813c61'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:30 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-39266bff-ded8-4ece-9432-6e60fa493dbd tempest-GroupSnapshotsTest-1099884862 None] group_snapshot 14b49eb0-3310-45d4-97af-1a90f8accb20: deleted successfully Aug 09 12:52:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-695821e0-7534-46d6-b5ef-7d65a52ce2d5" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-695821e0-7534-46d6-b5ef-7d65a52ce2d5" acquired by "delete_volume" :: waited 0.029s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:31 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f99bca5-2af8-4f0b-99ce-2cdf7a555f65]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:31 devstack sudo[101342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 Aug 09 12:52:31 devstack sudo[101342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:32 devstack sudo[101342]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5" returned: 0 in 0.554s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:32 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5 Aug 09 12:52:32 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:32 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-695821e0-7534-46d6-b5ef-7d65a52ce2d5" returned: 0 in 0.300s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-695821e0-7534-46d6-b5ef-7d65a52ce2d5" released by "delete_volume" :: held 0.938s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:32 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f0ac2b-2969-435b-a6e2-26031593d9b9]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:32 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 Aug 09 12:52:32 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:33 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569" returned: 0 in 0.556s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:33 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569 Aug 09 12:52:33 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:33 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569" returned: 0 in 0.487s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-affa6cc9-36f6-4f27-a8ef-a3d26e6e0569" released by "delete_volume" :: held 1.137s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:33 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Created reservations ['579c2292-0ee9-4df8-8eed-8cb05a075f56'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:33 devstack cinder-volume[89309]: WARNING cinder.quota [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-147904485 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-147904485, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:52:33 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Created reservations ['401dc2e7-c17a-41c2-b6b1-227795d48819', '2d469afb-af93-4665-bab6-d016a6eb2488', '7ecf1ac1-23e3-48af-812e-06dfc570681e', '6f4a07eb-7e4c-429f-b81a-3dc227c21578'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:34 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Created reservations ['032afcf6-efd8-49d0-b28a-d52de802106a', '7685da41-fab2-489c-9fb6-67ba24551398', 'b0eba927-1117-4306-8de9-9040deb297c0', '98d4fcef-ecff-429a-a137-36687c7eff8b'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:34 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:52:34 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:34 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.339s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:34 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:52:34 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b9e9885f-860a-4585-820a-9ea5e0b4a177 tempest-GroupSnapshotsTest-1099884862 None] Delete group completed successfully. Aug 09 12:52:36 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f202ee10-7563-4e55-91d8-32cc708eb42a tempest-GroupSnapshotsTest-1099884862 None] Group tempest-GroupSnapshotsTest-Group-15542291: creating Aug 09 12:52:36 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f202ee10-7563-4e55-91d8-32cc708eb42a tempest-GroupSnapshotsTest-1099884862 None] Group tempest-GroupSnapshotsTest-Group-15542291: created successfully Aug 09 12:52:36 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f202ee10-7563-4e55-91d8-32cc708eb42a tempest-GroupSnapshotsTest-1099884862 None] Create group completed successfully. Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Flow 'volume_create_manager' (ece896a8-88ab-4e4e-bafe-37c11ae6ad80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c58480-e13e-47eb-a406-d8c8b2f5da53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48c58480-e13e-47eb-a406-d8c8b2f5da53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1615231662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f9363ba-aad2-470b-84e4-944546ef7c31,host='devstack@QuobyteHD#QuobyteHD',id=566e7b09-85ce-479a-b4f8-cef2c3af44a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef954cd94fe4dd99255b96f4623b6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:38Z,use_quota=True,user_id='3000f724a1c441e7bf0210f85eccdbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88eda392-466b-4ed1-bec1-51577863525e),volume_type_id=88eda392-466b-4ed1-bec1-51577863525e)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d9554c-d535-43c1-bb82-297964eb754d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3d9554c-d535-43c1-bb82-297964eb754d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e7ccf6-94e7-4f13-84a7-f00a74188f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e7ccf6-94e7-4f13-84a7-f00a74188f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '566e7b09-85ce-479a-b4f8-cef2c3af44a6', 'volume_name': 'volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e8b8bb-982f-4795-a4da-a383997a8248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3e8b8bb-982f-4795-a4da-a383997a8248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0b6639-e299-4b94-82f5-2e285194f05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:38 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Volume 566e7b09-85ce-479a-b4f8-cef2c3af44a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6', 'volume_size': 1} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=1f9363ba-aad2-470b-84e4-944546ef7c31,created_at=2026-08-09T10:52:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1615231662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=1f9363ba-aad2-470b-84e4-944546ef7c31,host='devstack@QuobyteHD#QuobyteHD',id=566e7b09-85ce-479a-b4f8-cef2c3af44a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ef954cd94fe4dd99255b96f4623b6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:38Z,use_quota=True,user_id='3000f724a1c441e7bf0210f85eccdbb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(88eda392-466b-4ed1-bec1-51577863525e),volume_type_id=88eda392-466b-4ed1-bec1-51577863525e)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Creating volume 566e7b09-85ce-479a-b4f8-cef2c3af44a6 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:52:38 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:52:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:38 devstack sudo[101371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 1073741824 Aug 09 12:52:38 devstack sudo[101371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:39 devstack sudo[101371]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 1073741824" returned: 0 in 0.569s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:39 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 Aug 09 12:52:39 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:39 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6" returned: 0 in 0.348s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:52:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.985s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b0b6639-e299-4b94-82f5-2e285194f05a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c3eae6-21f3-4909-8d4a-d65a7c3cd958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:39 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Volume volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 (566e7b09-85ce-479a-b4f8-cef2c3af44a6): created successfully Aug 09 12:52:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c3eae6-21f3-4909-8d4a-d65a7c3cd958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Flow 'volume_create_manager' (ece896a8-88ab-4e4e-bafe-37c11ae6ad80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:39 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a8b4fe4a-0365-4cd0-9fa9-6c883a46788f tempest-GroupSnapshotsTest-1099884862 None] Created volume successfully. Aug 09 12:52:40 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:52:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Flow 'volume_create_manager' (55d8cf30-7eda-4c12-b418-0c1a8d67461c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a1fb11-cb1c-4f08-a1aa-e732f623ddb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a1fb11-cb1c-4f08-a1aa-e732f623ddb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-554764616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05d6dee-c070-45d8-95c6-51988821bbbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bd4dd34c034fbca24b060eb9e2b6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:40Z,use_quota=True,user_id='15f958832bab495c98e185b9415dc327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5bdaf03-71f7-40e9-ae37-3c49c7f66ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5bdaf03-71f7-40e9-ae37-3c49c7f66ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ff216d-5529-4e80-90b7-2d4822b5dfc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:40 devstack cinder-volume[89309]: DEBUG cinder.image.glance [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Creating Keystone auth plugin from conf {{(pid=89309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 12:52:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37ff216d-5529-4e80-90b7-2d4822b5dfc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f05d6dee-c070-45d8-95c6-51988821bbbd', 'volume_name': 'volume-f05d6dee-c070-45d8-95c6-51988821bbbd', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3429f7-405a-4608-be8c-55fa3074a3b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb3429f7-405a-4608-be8c-55fa3074a3b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37034dd-d83c-4e95-8e34-ba3a51cafab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:40 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Volume f05d6dee-c070-45d8-95c6-51988821bbbd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f05d6dee-c070-45d8-95c6-51988821bbbd', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 09 12:52:40 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Trying to clone f05d6dee-c070-45d8-95c6-51988821bbbd from image edd103c7-208a-494c-8e8e-975b743b3cc4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]). {{(pid=89309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 12:52:41 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Image download 20.69 MB at 20.69 MB/s Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d57d4f-1822-4b35-9874-02c1d45ef9ac]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:41 devstack sudo[101419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD Aug 09 12:52:41 devstack sudo[101419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:41 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] GroupSnapshot 1aa13d21-6f0b-42f0-b60b-bcb082533686: creating. Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] Group snapshot 1aa13d21-6f0b-42f0-b60b-bcb082533686: creating. {{(pid=89309) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] Creating offline snapshot aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 of volume 566e7b09-85ce-479a-b4f8-cef2c3af44a6 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6086c295-c001-4e51-9774-4b18ebffcc5a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:41 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 Aug 09 12:52:41 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:41 devstack sudo[101419]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD" returned: 0 in 0.381s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Temporary image edd103c7-208a-494c-8e8e-975b743b3cc4 is fetched for user 15f958832bab495c98e185b9415dc327. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9846ab94-d873-4b4d-b0b5-12af1153e8cd]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:41 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD Aug 09 12:52:41 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:41 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6" returned: 0 in 0.375s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:41 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 1G Aug 09 12:52:41 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:41 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD" returned: 0 in 0.353s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:42 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 1G" returned: 0 in 0.458s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:42 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 Aug 09 12:52:42 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:42 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1" returned: 0 in 0.294s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:42 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:52:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:42 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 Aug 09 12:52:42 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:42 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1" returned: 0 in 0.252s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:42 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.info Aug 09 12:52:42 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:43 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.info" returned: 0 in 0.272s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:43 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.info is being set with open permissions: ugo+rw: NotImplementedError Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:43 devstack sudo[101451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.info Aug 09 12:52:43 devstack sudo[101451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Flow 'volume_create_manager' (230ec61d-c7df-4e6a-a507-32ca50e24713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597eced1-f0c9-4c63-aed5-0b58d930d2e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (597eced1-f0c9-4c63-aed5-0b58d930d2e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1264706734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03f3750-d133-4c56-aec6-bdbd2dc68e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38a04b6282942c7b73a8f0418e9a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:43Z,use_quota=True,user_id='63a159cdb2934d14b1318e99627b8249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d85466a1-4e0b-4ac9-a02c-03fc9462c109),volume_type_id=d85466a1-4e0b-4ac9-a02c-03fc9462c109)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e017d974-fd64-4c9d-b2e6-e8d2210a2256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e017d974-fd64-4c9d-b2e6-e8d2210a2256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3366ec-d039-480c-a295-e420b39f4d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df3366ec-d039-480c-a295-e420b39f4d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b03f3750-d133-4c56-aec6-bdbd2dc68e30', 'volume_name': 'volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90bb5f79-6b3f-47cf-82af-c745328d45fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90bb5f79-6b3f-47cf-82af-c745328d45fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdf7fa8-3476-4271-9f1b-7f812481d689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:43 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Volume b03f3750-d133-4c56-aec6-bdbd2dc68e30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30', 'volume_size': 1} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:43 devstack sudo[101451]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.info" returned: 0 in 0.306s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.447s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-554764616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f05d6dee-c070-45d8-95c6-51988821bbbd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f0bd4dd34c034fbca24b060eb9e2b6c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:40Z,use_quota=True,user_id='15f958832bab495c98e185b9415dc327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Creating volume f05d6dee-c070-45d8-95c6-51988821bbbd {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:52:43 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:43 devstack sudo[101454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd 1073741824 Aug 09 12:52:43 devstack sudo[101454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:43 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-fae36ab1-1750-43b2-8bca-fc3578b6c600 tempest-GroupSnapshotsTest-1099884862 None] group_snapshot 1aa13d21-6f0b-42f0-b60b-bcb082533686: created successfully Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Flow 'volume_create_manager' (1a4c26af-e13b-48af-8b3a-a2a3b034ffd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4d6a92-ccaa-40c6-94c8-b3bdc8764cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de4d6a92-ccaa-40c6-94c8-b3bdc8764cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1359256902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38938261-9d3e-442f-a921-24c7d93dc106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38a04b6282942c7b73a8f0418e9a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:43Z,use_quota=True,user_id='63a159cdb2934d14b1318e99627b8249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84d941fe-3410-41bf-bfb0-e4af7dac4f71),volume_type_id=84d941fe-3410-41bf-bfb0-e4af7dac4f71)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87acbcc9-f211-4a54-b7c4-e446fe831a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87acbcc9-f211-4a54-b7c4-e446fe831a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d484569-13ff-4bef-86df-991571d7ace6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d484569-13ff-4bef-86df-991571d7ace6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38938261-9d3e-442f-a921-24c7d93dc106', 'volume_name': 'volume-38938261-9d3e-442f-a921-24c7d93dc106', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc98b3f-cec8-456b-a549-9fd050479ad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fc98b3f-cec8-456b-a549-9fd050479ad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962766c1-202d-49fc-b74f-35ad8af09628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:43 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Volume 38938261-9d3e-442f-a921-24c7d93dc106: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38938261-9d3e-442f-a921-24c7d93dc106', 'volume_size': 1} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:43 devstack sudo[101454]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd 1073741824" returned: 0 in 0.473s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=123,cinder:SELECT=128,cinder:INSERT=35,cinder:DELETE=6 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=126,cinder:SELECT=135,cinder:INSERT=25,cinder:DELETE=4 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:52:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:43 devstack sudo[101460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd Aug 09 12:52:43 devstack sudo[101460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:44 devstack sudo[101460]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd" returned: 0 in 0.265s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.944s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1264706734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b03f3750-d133-4c56-aec6-bdbd2dc68e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38a04b6282942c7b73a8f0418e9a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:43Z,use_quota=True,user_id='63a159cdb2934d14b1318e99627b8249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d85466a1-4e0b-4ac9-a02c-03fc9462c109),volume_type_id=d85466a1-4e0b-4ac9-a02c-03fc9462c109)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Creating volume b03f3750-d133-4c56-aec6-bdbd2dc68e30 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:52:44 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:52:44 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30 1073741824 Aug 09 12:52:44 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Flow 'volume_create_manager' (2c5a9b4d-fd6f-4b39-b370-04e071803b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7229d88d-8ae3-4697-82d7-b590ac9e0d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7229d88d-8ae3-4697-82d7-b590ac9e0d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1899567505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6c15da7-2e88-47cb-94c1-a22ab6632342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38a04b6282942c7b73a8f0418e9a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:44Z,use_quota=True,user_id='63a159cdb2934d14b1318e99627b8249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(449f310f-7d2a-4265-a4a7-9524664e01dc),volume_type_id=449f310f-7d2a-4265-a4a7-9524664e01dc)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69694f4-ffce-47e3-a6df-3ae2e475d083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f69694f4-ffce-47e3-a6df-3ae2e475d083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f830322-f9fa-4c94-8985-7442fb23a64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.image.glance [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Creating Keystone auth plugin from conf {{(pid=89309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Attempting download of edd103c7-208a-494c-8e8e-975b743b3cc4 ((None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}])) to volume f05d6dee-c070-45d8-95c6-51988821bbbd. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[80df3336-784a-4933-bc60-5209f366d67c]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4gublrcw {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:44 devstack sudo[101465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4gublrcw Aug 09 12:52:44 devstack sudo[101465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f830322-f9fa-4c94-8985-7442fb23a64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd6c15da7-2e88-47cb-94c1-a22ab6632342', 'volume_name': 'volume-d6c15da7-2e88-47cb-94c1-a22ab6632342', 'volume_size': 1, 'image_id': 'ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--997903308', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f38a04b6282942c7b73a8f0418e9a770', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef', 'created_at': datetime.datetime(2026, 8, 9, 10, 52, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef/file', 'properties': {}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b605f8-cfbb-4f01-855b-01dbf543e8e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39b605f8-cfbb-4f01-855b-01dbf543e8e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dded9c97-d983-4b01-90a0-079a0e726aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:44 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Volume d6c15da7-2e88-47cb-94c1-a22ab6632342: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d6c15da7-2e88-47cb-94c1-a22ab6632342', 'volume_size': 1, 'image_id': 'ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--997903308', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f38a04b6282942c7b73a8f0418e9a770', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef', 'created_at': datetime.datetime(2026, 8, 9, 10, 52, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef/file', 'properties': {}}, 'image_service': } Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Trying to clone d6c15da7-2e88-47cb-94c1-a22ab6632342 from image ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef at location (None, [{'url': 'file:///opt/stack/data/glance/images/ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef', 'metadata': {}}]). {{(pid=89309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 12:52:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] group_snapshot 1aa13d21-6f0b-42f0-b60b-bcb082533686: deleting Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] group_snapshot 1aa13d21-6f0b-42f0-b60b-bcb082533686: deleting {{(pid=89309) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Aug 09 12:52:44 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-566e7b09-85ce-479a-b4f8-cef2c3af44a6" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30 1073741824" returned: 0 in 0.543s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-566e7b09-85ce-479a-b4f8-cef2c3af44a6" acquired by "delete_snapshot" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Deleting offline snapshot aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 of volume 566e7b09-85ce-479a-b4f8-cef2c3af44a6 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] snapshot_file for this snap is: volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cbd06a4-d673-4c45-b024-4fcd9eaf707d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:44 devstack sudo[101473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30 Aug 09 12:52:44 devstack sudo[101473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:44 devstack sudo[101465]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4gublrcw" returned: 0 in 0.484s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4gublrcw {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:45 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 Aug 09 12:52:45 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:45 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4gublrcw Aug 09 12:52:45 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:45 devstack sudo[101473]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30" returned: 0 in 0.344s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.573s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:52:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1359256902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38938261-9d3e-442f-a921-24c7d93dc106,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38a04b6282942c7b73a8f0418e9a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:43Z,use_quota=True,user_id='63a159cdb2934d14b1318e99627b8249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84d941fe-3410-41bf-bfb0-e4af7dac4f71),volume_type_id=84d941fe-3410-41bf-bfb0-e4af7dac4f71)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Creating volume 38938261-9d3e-442f-a921-24c7d93dc106 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:52:45 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-38938261-9d3e-442f-a921-24c7d93dc106 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bdf7fa8-3476-4271-9f1b-7f812481d689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:45 devstack sudo[101480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-38938261-9d3e-442f-a921-24c7d93dc106 1073741824 Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce2544f-e441-4529-9959-ef72d45e6550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:45 devstack sudo[101480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:45 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Volume volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30 (b03f3750-d133-4c56-aec6-bdbd2dc68e30): created successfully Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ce2544f-e441-4529-9959-ef72d45e6550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Flow 'volume_create_manager' (230ec61d-c7df-4e6a-a507-32ca50e24713) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:45 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e9987d8a-c8ab-4c41-9c3e-13b23dd326ae tempest-TestInstancesWithCinderVolumes-777629701 None] Created volume successfully. Aug 09 12:52:45 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4gublrcw" returned: 1 in 0.454s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_4gublrcw' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd90044f-bfd6-441a-ad2c-fe0f265e75c4]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:45 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1" returned: 0 in 0.510s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b041697-6fb9-466f-97ad-4f4d99fd6b4e]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:45 devstack sudo[101487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD Aug 09 12:52:45 devstack sudo[101487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:45 devstack sudo[101488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 Aug 09 12:52:45 devstack sudo[101488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:45 devstack sudo[101480]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-38938261-9d3e-442f-a921-24c7d93dc106 1073741824" returned: 0 in 0.523s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:45 devstack sudo[101487]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD" returned: 0 in 0.379s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] edd103c7-208a-494c-8e8e-975b743b3cc4 was qcow2, converting to qcow2 {{(pid=89309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:45 devstack sudo[101500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd Aug 09 12:52:45 devstack sudo[101500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-38938261-9d3e-442f-a921-24c7d93dc106 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:45 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-38938261-9d3e-442f-a921-24c7d93dc106 Aug 09 12:52:45 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:45 devstack sudo[101488]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6" returned: 0 in 0.424s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:45 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 Aug 09 12:52:45 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:46 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-38938261-9d3e-442f-a921-24c7d93dc106" returned: 0 in 0.273s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:52:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (962766c1-202d-49fc-b74f-35ad8af09628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38938261-9d3e-442f-a921-24c7d93dc106', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b906f121-3cfb-4920-a51a-9d7dd4716b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:46 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Volume volume-38938261-9d3e-442f-a921-24c7d93dc106 (38938261-9d3e-442f-a921-24c7d93dc106): created successfully Aug 09 12:52:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b906f121-3cfb-4920-a51a-9d7dd4716b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Flow 'volume_create_manager' (1a4c26af-e13b-48af-8b3a-a2a3b034ffd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:46 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a282c87d-666b-4788-aa6b-56cee2818f28 tempest-TestInstancesWithCinderVolumes-777629701 None] Created volume successfully. Aug 09 12:52:46 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1" returned: 0 in 0.470s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:46 devstack sudo[101517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1 Aug 09 12:52:46 devstack sudo[101517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:46 devstack sudo[101517]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6.aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1" returned: 0 in 0.337s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-aa67fef6-4aeb-4c61-b98c-e9a71e6ddfb1" released by "_delete_snapshot" :: held 1.910s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-566e7b09-85ce-479a-b4f8-cef2c3af44a6" released by "delete_snapshot" :: held 1.944s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:46 devstack cinder-volume[89309]: WARNING cinder.quota [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1525353791 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1525353791, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:52:46 devstack cinder-volume[89309]: WARNING cinder.quota [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1525353791 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1525353791, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:52:46 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] Created reservations ['b2b666fc-d471-46f6-a4bb-eed1952d2bc8', '38c6e0f9-e4ec-4148-b0bf-43b1e0837078', '292c43db-3db5-49ed-934b-9f1a8e74079b', 'ea0a498c-32ae-4a2e-85a0-8f9a88ed6fb1'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:46 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-24e8b7f3-e34b-47d6-be86-5279b65e7de4 tempest-GroupSnapshotsTest-1099884862 None] group_snapshot 1aa13d21-6f0b-42f0-b60b-bcb082533686: deleted successfully Aug 09 12:52:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "cinder-quobyte-566e7b09-85ce-479a-b4f8-cef2c3af44a6" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-566e7b09-85ce-479a-b4f8-cef2c3af44a6" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:47 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfefb9b4-4937-4042-a7aa-68dd660e2b54]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:47 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 Aug 09 12:52:47 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:47 devstack sudo[101500]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd" returned: 0 in 1.931s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:47 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_5_mubp7bdevstack@QuobyteHD, size 112.00 MB, duration 1.93 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:52:47 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Converted 112.00 MB image at 57.95 MB/s Aug 09 12:52:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:47 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd 1G Aug 09 12:52:47 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:47 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6" returned: 0 in 0.377s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:47 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6 Aug 09 12:52:47 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:48 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd 1G" returned: 0 in 0.364s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Downloaded image edd103c7-208a-494c-8e8e-975b743b3cc4 ((None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}])) to volume f05d6dee-c070-45d8-95c6-51988821bbbd successfully. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Temporary image edd103c7-208a-494c-8e8e-975b743b3cc4 for user 15f958832bab495c98e185b9415dc327 is deleted. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Marking volume f05d6dee-c070-45d8-95c6-51988821bbbd as bootable. {{(pid=89309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Copying metadata from image edd103c7-208a-494c-8e8e-975b743b3cc4 to f05d6dee-c070-45d8-95c6-51988821bbbd. {{(pid=89309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Creating volume glance metadata for volume f05d6dee-c070-45d8-95c6-51988821bbbd backed by image edd103c7-208a-494c-8e8e-975b743b3cc4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c37034dd-d83c-4e95-8e34-ba3a51cafab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f05d6dee-c070-45d8-95c6-51988821bbbd', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:48 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745dd449-1844-4681-8d59-b6f3cd45b9e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-566e7b09-85ce-479a-b4f8-cef2c3af44a6" returned: 0 in 0.283s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:48 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Volume volume-f05d6dee-c070-45d8-95c6-51988821bbbd (f05d6dee-c070-45d8-95c6-51988821bbbd): created successfully Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (745dd449-1844-4681-8d59-b6f3cd45b9e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Flow 'volume_create_manager' (55d8cf30-7eda-4c12-b418-0c1a8d67461c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Lock "cinder-quobyte-566e7b09-85ce-479a-b4f8-cef2c3af44a6" released by "delete_volume" :: held 0.747s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-388d7c94-4d2a-43d5-a160-963cf5f040e3 tempest-VolumesImageMetadata-273441908 None] Created volume successfully. Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Created reservations ['88be2064-a0fc-4e8d-a522-4503e9e5993b'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:48 devstack cinder-volume[89309]: WARNING cinder.quota [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1525353791 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1525353791, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Created reservations ['a02c59d0-9bc7-4a8a-a7d8-2c6b347f3f4b', '9a0b2f2d-2d46-4c45-a947-e6b7968b1d2a', '01e08ad4-3db2-40bd-95cd-4bfe41e867df', 'dcc2e875-bb1d-4624-9851-71b8589ec313'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:48 devstack sudo[101534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:52:48 devstack sudo[101534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:48 devstack sudo[101534]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.337s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:48 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:52:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c8844722-4c6c-4091-8919-bb802ea3fcd6 tempest-GroupSnapshotsTest-1099884862 None] Delete group completed successfully. Aug 09 12:52:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Acquiring lock "cinder-f05d6dee-c070-45d8-95c6-51988821bbbd-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Lock "cinder-f05d6dee-c070-45d8-95c6-51988821bbbd-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Acquiring lock "cinder-quobyte-f05d6dee-c070-45d8-95c6-51988821bbbd" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Lock "cinder-quobyte-f05d6dee-c070-45d8-95c6-51988821bbbd" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:49 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96374e0-a913-41af-bb8a-724273a49946]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:49 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd Aug 09 12:52:49 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:49 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD, size 20.69 MB, duration 4.76 sec {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 12:52:49 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Image download 20.69 MB at 4.34 MB/s Aug 09 12:52:49 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[20e5f939-dd2d-47d1-8a29-517df344d360]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:49 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD Aug 09 12:52:49 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:49 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd" returned: 0 in 0.522s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:49 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd Aug 09 12:52:49 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:49 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD" returned: 0 in 0.402s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:49 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Temporary image ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef is fetched for user 63a159cdb2934d14b1318e99627b8249. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[26e4a7e6-5ae8-4c6b-811a-d3b5961ae025]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:50 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f05d6dee-c070-45d8-95c6-51988821bbbd" returned: 0 in 0.345s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:50 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD Aug 09 12:52:50 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Lock "cinder-quobyte-f05d6dee-c070-45d8-95c6-51988821bbbd" released by "delete_volume" :: held 0.932s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Created reservations ['b116f5a5-a853-4a92-89b9-6b12db754e0b', 'cbd6e105-c445-40bb-a0e4-1f0176ad0172', '3e6be70d-961f-4840-91a9-bf7ae8cb1307', '2864abec-275f-424c-be05-7b5285ed985a'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:50 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:52:50 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:50 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD" returned: 0 in 0.454s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:52:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1899567505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d6c15da7-2e88-47cb-94c1-a22ab6632342,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f38a04b6282942c7b73a8f0418e9a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:52:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:52:44Z,use_quota=True,user_id='63a159cdb2934d14b1318e99627b8249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(449f310f-7d2a-4265-a4a7-9524664e01dc),volume_type_id=449f310f-7d2a-4265-a4a7-9524664e01dc)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Creating volume d6c15da7-2e88-47cb-94c1-a22ab6632342 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:52:50 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:50 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 1073741824 Aug 09 12:52:50 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:50 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.275s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:52:50 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Deleted volume successfully. Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-03769e72-9f4b-40ae-bd0a-4af415d7d428 tempest-VolumesImageMetadata-273441908 None] Lock "cinder-f05d6dee-c070-45d8-95c6-51988821bbbd-delete_volume" released by "delete_volume" :: held 1.502s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:50 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 1073741824" returned: 0 in 0.485s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:51 devstack sudo[101566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 Aug 09 12:52:51 devstack sudo[101566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:51 devstack sudo[101566]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342" returned: 0 in 0.275s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:52:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:51 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Attempting download of ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef ((None, [{'url': 'file:///opt/stack/data/glance/images/ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef', 'metadata': {}}])) to volume d6c15da7-2e88-47cb-94c1-a22ab6632342. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 12:52:51 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[50f4ffb0-6073-4295-9039-7bbda6c717b2]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef__5d8vq78 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:51 devstack sudo[101569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef__5d8vq78 Aug 09 12:52:51 devstack sudo[101569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:51 devstack sudo[101569]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef__5d8vq78" returned: 0 in 0.370s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef__5d8vq78 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:51 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef__5d8vq78 Aug 09 12:52:51 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:52 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef__5d8vq78" returned: 1 in 0.460s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef__5d8vq78' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:52:52 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1395bf-fa1b-4b14-85df-021c05274c77]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:52 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD Aug 09 12:52:52 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:52 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:52 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef was qcow2, converting to qcow2 {{(pid=89309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 12:52:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:52 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 Aug 09 12:52:52 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:55 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342" returned: 0 in 2.599s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:55 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef_1nyodxjwdevstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:52:55 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Converted 112.00 MB image at 43.08 MB/s Aug 09 12:52:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:55 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 1G Aug 09 12:52:55 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:55 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 1G" returned: 0 in 0.477s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:55 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Downloaded image ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef ((None, [{'url': 'file:///opt/stack/data/glance/images/ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef', 'metadata': {}}])) to volume d6c15da7-2e88-47cb-94c1-a22ab6632342 successfully. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 12:52:55 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Temporary image ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef for user 63a159cdb2934d14b1318e99627b8249 is deleted. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 12:52:55 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Marking volume d6c15da7-2e88-47cb-94c1-a22ab6632342 as bootable. {{(pid=89309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 12:52:55 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-12deaa00-6ba6-4317-a00b-eb4dfec97a5a req-f8272cd2-f858-4c83-a78f-90041905c682 tempest-TestMinimumBasicScenario-99153121 None] Terminate volume connection completed successfully. Aug 09 12:52:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-12deaa00-6ba6-4317-a00b-eb4dfec97a5a req-f8272cd2-f858-4c83-a78f-90041905c682 tempest-TestMinimumBasicScenario-99153121 None] Deleting attachment ac40da95-4e42-41a3-bbdb-5cc39dcf2d0b. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:52:55 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Copying metadata from image ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef to d6c15da7-2e88-47cb-94c1-a22ab6632342. {{(pid=89309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 12:52:55 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Creating volume glance metadata for volume d6c15da7-2e88-47cb-94c1-a22ab6632342 backed by image ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef with: {'image_id': 'ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef', 'image_name': 'tempest-scenario-img--997903308', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 12:52:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dded9c97-d983-4b01-90a0-079a0e726aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d6c15da7-2e88-47cb-94c1-a22ab6632342', 'volume_size': 1, 'image_id': 'ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--997903308', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f38a04b6282942c7b73a8f0418e9a770', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef', 'created_at': datetime.datetime(2026, 8, 9, 10, 52, 40, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ebc8a44e-a552-4bf3-babd-cf05d9fbd0ef/file', 'properties': {}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b1339e-ce31-4ee4-a824-d8417c504c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:52:56 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Volume volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 (d6c15da7-2e88-47cb-94c1-a22ab6632342): created successfully Aug 09 12:52:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42b1339e-ce31-4ee4-a824-d8417c504c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:52:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Flow 'volume_create_manager' (2c5a9b4d-fd6f-4b39-b370-04e071803b6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:52:56 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-855647f7-c1b4-4e88-ac7d-d3f434b4520e tempest-TestInstancesWithCinderVolumes-777629701 None] Created volume successfully. Aug 09 12:52:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Acquiring lock "cinder-546121f5-a2db-4371-b3ca-0602588e1af6-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Lock "cinder-546121f5-a2db-4371-b3ca-0602588e1af6-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Acquiring lock "cinder-quobyte-546121f5-a2db-4371-b3ca-0602588e1af6" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:52:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Lock "cinder-quobyte-546121f5-a2db-4371-b3ca-0602588e1af6" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:52:56 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d777756-bcb8-4223-903f-50de36a81ae6]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:52:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-546121f5-a2db-4371-b3ca-0602588e1af6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:56 devstack sudo[101622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-546121f5-a2db-4371-b3ca-0602588e1af6 Aug 09 12:52:56 devstack sudo[101622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:57 devstack sudo[101622]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-546121f5-a2db-4371-b3ca-0602588e1af6" returned: 0 in 0.510s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-546121f5-a2db-4371-b3ca-0602588e1af6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:57 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-546121f5-a2db-4371-b3ca-0602588e1af6 Aug 09 12:52:57 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:57 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-546121f5-a2db-4371-b3ca-0602588e1af6" returned: 0 in 0.307s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Lock "cinder-quobyte-546121f5-a2db-4371-b3ca-0602588e1af6" released by "delete_volume" :: held 0.886s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Created reservations ['ed567e08-ef98-4eb4-9081-4335687182e0', '800fedb4-3bd3-4e24-b9e4-813926419dc6', 'cbd56a71-e92b-4018-8f0c-e616027cef77', 'cc25b9fa-23a6-4352-9f5d-076be72b7797'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:52:57 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:52:57 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:57 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:52:57 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:52:57 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.328s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:57 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:52:57 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Deleted volume successfully. Aug 09 12:52:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-31a87c55-ac09-41c5-9414-de1fda760893 tempest-TestMinimumBasicScenario-99153121 None] Lock "cinder-546121f5-a2db-4371-b3ca-0602588e1af6-delete_volume" released by "delete_volume" :: held 1.508s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:52:58 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Aug 09 12:52:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.405s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:52:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:52:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:52:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:52:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Flow 'volume_create_manager' (5aba9a29-3ca9-4b04-a3d3-e73add3efcdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b899415-9800-4f68-9793-f4cbceed3867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b899415-9800-4f68-9793-f4cbceed3867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1947609924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62679bbe-2a2d-47f0-a372-a03d4b1843c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac3951b04584bac9b9a661ba82fcaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:01Z,use_quota=True,user_id='d426e4140f384ad6855e6704e53cc634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c2435d-942e-498d-9a3e-1a7412a77432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87c2435d-942e-498d-9a3e-1a7412a77432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c8ce81-3d3b-4f6b-b4b9-01e28ed234f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c8ce81-3d3b-4f6b-b4b9-01e28ed234f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '62679bbe-2a2d-47f0-a372-a03d4b1843c1', 'volume_name': 'volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7dd95f4-33f4-4e73-9188-cb69534c6fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7dd95f4-33f4-4e73-9188-cb69534c6fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8cc2d3-6533-4401-97a6-74fc335ea88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:01 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Volume 62679bbe-2a2d-47f0-a372-a03d4b1843c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1', 'volume_size': 1} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1947609924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=62679bbe-2a2d-47f0-a372-a03d4b1843c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aac3951b04584bac9b9a661ba82fcaf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:01Z,use_quota=True,user_id='d426e4140f384ad6855e6704e53cc634',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Creating volume 62679bbe-2a2d-47f0-a372-a03d4b1843c1 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:53:01 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:01 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1 1073741824 Aug 09 12:53:01 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-30d6b4ea-fb2d-46f9-8e6d-4a8a7335fc30 req-672c8018-b3aa-4c41-a87a-1252bb5e6bf3 tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:02 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1 1073741824" returned: 0 in 0.639s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:02 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1 Aug 09 12:53:02 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:02 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1" returned: 0 in 0.321s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] <== create_volume: return (1053ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:53:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.056s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-30d6b4ea-fb2d-46f9-8e6d-4a8a7335fc30 req-672c8018-b3aa-4c41-a87a-1252bb5e6bf3 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.582s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb8cc2d3-6533-4401-97a6-74fc335ea88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bd1e02-ff50-4939-8d8c-40fda102bcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-30d6b4ea-fb2d-46f9-8e6d-4a8a7335fc30 req-672c8018-b3aa-4c41-a87a-1252bb5e6bf3 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.039s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:02 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Volume volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1 (62679bbe-2a2d-47f0-a372-a03d4b1843c1): created successfully Aug 09 12:53:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36bd1e02-ff50-4939-8d8c-40fda102bcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Flow 'volume_create_manager' (5aba9a29-3ca9-4b04-a3d3-e73add3efcdc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:02 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-6bcd0f43-dde0-455e-969a-cf8b525aa17d tempest-VolumesMetadataTest-1759378981 None] Created volume successfully. Aug 09 12:53:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-30d6b4ea-fb2d-46f9-8e6d-4a8a7335fc30 req-672c8018-b3aa-4c41-a87a-1252bb5e6bf3 tempest-TestInstancesWithCinderVolumes-777629701 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-d6c15da7-2e88-47cb-94c1-a22ab6632342', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30e99449-ac30-48ed-8b0f-b84661fb45cf', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:53:02 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-30d6b4ea-fb2d-46f9-8e6d-4a8a7335fc30 req-672c8018-b3aa-4c41-a87a-1252bb5e6bf3 tempest-TestInstancesWithCinderVolumes-777629701 None] attachment_update completed successfully. Aug 09 12:53:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Acquiring lock "cinder-62679bbe-2a2d-47f0-a372-a03d4b1843c1-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Lock "cinder-62679bbe-2a2d-47f0-a372-a03d4b1843c1-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Acquiring lock "cinder-quobyte-62679bbe-2a2d-47f0-a372-a03d4b1843c1" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Lock "cinder-quobyte-62679bbe-2a2d-47f0-a372-a03d4b1843c1" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:04 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8ef6626-b7a7-4e62-a74a-e3c3677a7f4b]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:53:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:04 devstack sudo[101686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1 Aug 09 12:53:04 devstack sudo[101686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:04 devstack sudo[101686]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1" returned: 0 in 0.564s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:04 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1 Aug 09 12:53:04 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:04 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-62679bbe-2a2d-47f0-a372-a03d4b1843c1" returned: 0 in 0.290s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Lock "cinder-quobyte-62679bbe-2a2d-47f0-a372-a03d4b1843c1" released by "delete_volume" :: held 0.899s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:05 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Created reservations ['fa77a9b3-080f-4d94-a38b-22aae9cd8428', 'b45134a2-c70f-4d79-b4e5-8b2d1182db2b', '99989d23-8697-49c3-8705-3b8282999022', '08226cc7-07c0-4b28-9b86-9b6245511f80'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:53:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:05 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:05 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:05 devstack sudo[101696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:53:05 devstack sudo[101696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:05 devstack sudo[101696]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.300s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:05 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:53:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Deleted volume successfully. Aug 09 12:53:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bbe66f23-be2a-472c-81f5-62d725d45d55 tempest-VolumesMetadataTest-1759378981 None] Lock "cinder-62679bbe-2a2d-47f0-a372-a03d4b1843c1-delete_volume" released by "delete_volume" :: held 1.480s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:12 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Flow 'volume_create_manager' (70ce2d08-8a31-4734-8006-96914aa9cd84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc15f00-83a8-4f4e-a3b6-9615dd873c10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cc15f00-83a8-4f4e-a3b6-9615dd873c10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1994862112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fa4142-67c4-4158-a4ee-588496e65f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a58b93a46f44b2d971adfacaf44c21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:13Z,use_quota=True,user_id='0944784b46f44af9abf3cc38a2a18449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcca0b29-19d1-4c4c-b7a6-9e3dd2dfdb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcca0b29-19d1-4c4c-b7a6-9e3dd2dfdb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de547ed8-ef48-4e19-a564-9bce8ee9325f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de547ed8-ef48-4e19-a564-9bce8ee9325f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82fa4142-67c4-4158-a4ee-588496e65f27', 'volume_name': 'volume-82fa4142-67c4-4158-a4ee-588496e65f27', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7213e6-4fe2-46fd-9d64-731bbe236329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7213e6-4fe2-46fd-9d64-731bbe236329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b92ff9-2fd6-4cce-947c-08828aa9faaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:13 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Volume 82fa4142-67c4-4158-a4ee-588496e65f27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82fa4142-67c4-4158-a4ee-588496e65f27', 'volume_size': 1} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1994862112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82fa4142-67c4-4158-a4ee-588496e65f27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a58b93a46f44b2d971adfacaf44c21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:13Z,use_quota=True,user_id='0944784b46f44af9abf3cc38a2a18449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Creating volume 82fa4142-67c4-4158-a4ee-588496e65f27 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:53:13 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-82fa4142-67c4-4158-a4ee-588496e65f27 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:13 devstack sudo[102167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-82fa4142-67c4-4158-a4ee-588496e65f27 1073741824 Aug 09 12:53:13 devstack sudo[102167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:13 devstack sudo[102167]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-82fa4142-67c4-4158-a4ee-588496e65f27 1073741824" returned: 0 in 0.609s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-82fa4142-67c4-4158-a4ee-588496e65f27 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:13 devstack sudo[102173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-82fa4142-67c4-4158-a4ee-588496e65f27 Aug 09 12:53:13 devstack sudo[102173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:14 devstack sudo[102173]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-82fa4142-67c4-4158-a4ee-588496e65f27" returned: 0 in 0.553s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:53:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77b92ff9-2fd6-4cce-947c-08828aa9faaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82fa4142-67c4-4158-a4ee-588496e65f27', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365e1106-da30-444d-9767-5d5760ce1000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:14 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Volume volume-82fa4142-67c4-4158-a4ee-588496e65f27 (82fa4142-67c4-4158-a4ee-588496e65f27): created successfully Aug 09 12:53:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (365e1106-da30-444d-9767-5d5760ce1000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Flow 'volume_create_manager' (70ce2d08-8a31-4734-8006-96914aa9cd84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:14 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-983d809f-569f-4b79-afa5-df47231c50c1 tempest-VolumesTransfersV355Test-822310223 None] Created volume successfully. Aug 09 12:53:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-3e008c38-3435-4ba4-a067-af772027f40b tempest-VolumesTransfersV355Test-365571465 None] Transfer volume completed successfully. Aug 09 12:53:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Acquiring lock "cinder-82fa4142-67c4-4158-a4ee-588496e65f27-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Lock "cinder-82fa4142-67c4-4158-a4ee-588496e65f27-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Acquiring lock "cinder-quobyte-82fa4142-67c4-4158-a4ee-588496e65f27" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Lock "cinder-quobyte-82fa4142-67c4-4158-a4ee-588496e65f27" acquired by "delete_volume" :: waited 0.040s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:18 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bdc8dc-547e-44d5-9b3e-f0bbd9a3a5ce]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:53:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-82fa4142-67c4-4158-a4ee-588496e65f27 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:18 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-82fa4142-67c4-4158-a4ee-588496e65f27 Aug 09 12:53:18 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:18 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-82fa4142-67c4-4158-a4ee-588496e65f27" returned: 0 in 0.583s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-82fa4142-67c4-4158-a4ee-588496e65f27 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:18 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-82fa4142-67c4-4158-a4ee-588496e65f27 Aug 09 12:53:18 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Flow 'volume_create_manager' (3a708014-8835-4354-b49a-ea80b24644b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355c89cf-a100-4b96-9180-95c9d0a44cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (355c89cf-a100-4b96-9180-95c9d0a44cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-463327384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76178401-bef7-4b20-b607-43e162ebad15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e20c99bf944747a87877ba9d522760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:19Z,use_quota=True,user_id='d1804845225a4d969524fc69377fde80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94b73307-36d3-44a4-8fe2-6fae2faf4f17),volume_type_id=94b73307-36d3-44a4-8fe2-6fae2faf4f17)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7369580f-534a-488d-ae2d-fe51afd53b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7369580f-534a-488d-ae2d-fe51afd53b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c62a99d-cf18-4eca-bc6d-7fe04038d96a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c62a99d-cf18-4eca-bc6d-7fe04038d96a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76178401-bef7-4b20-b607-43e162ebad15', 'volume_name': 'volume-76178401-bef7-4b20-b607-43e162ebad15', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f797f2-a87e-490b-801f-7c70d5c285a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89f797f2-a87e-490b-801f-7c70d5c285a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73a7291-0062-4a2b-a178-8f80d08e4f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:19 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Volume 76178401-bef7-4b20-b607-43e162ebad15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76178401-bef7-4b20-b607-43e162ebad15', 'volume_size': 1} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-463327384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76178401-bef7-4b20-b607-43e162ebad15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4e20c99bf944747a87877ba9d522760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:19Z,use_quota=True,user_id='d1804845225a4d969524fc69377fde80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(94b73307-36d3-44a4-8fe2-6fae2faf4f17),volume_type_id=94b73307-36d3-44a4-8fe2-6fae2faf4f17)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Creating volume 76178401-bef7-4b20-b607-43e162ebad15 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:53:19 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-76178401-bef7-4b20-b607-43e162ebad15 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:19 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-82fa4142-67c4-4158-a4ee-588496e65f27" returned: 0 in 0.664s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:19 devstack sudo[102189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-76178401-bef7-4b20-b607-43e162ebad15 1073741824 Aug 09 12:53:19 devstack sudo[102189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Lock "cinder-quobyte-82fa4142-67c4-4158-a4ee-588496e65f27" released by "delete_volume" :: held 1.378s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Created reservations ['2d700e70-113b-4063-a4b2-2224a0f93bf8', '70988cb0-c6a7-4ce6-8fc6-a213731f2880', '257ccfb2-0526-4a19-aad3-aae99590f9b5', 'fdd38629-c8ae-4bec-b1d9-c07a6fa783cb'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:19 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:53:19 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:20 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.441s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:20 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:53:20 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Deleted volume successfully. Aug 09 12:53:20 devstack sudo[102189]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-76178401-bef7-4b20-b607-43e162ebad15 1073741824" returned: 0 in 0.851s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3e5c1e2b-b29e-4048-aef4-7c8f70133e59 tempest-VolumesTransfersV355Test-1312171936 None] Lock "cinder-82fa4142-67c4-4158-a4ee-588496e65f27-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-76178401-bef7-4b20-b607-43e162ebad15 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:20 devstack sudo[102199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-76178401-bef7-4b20-b607-43e162ebad15 Aug 09 12:53:20 devstack sudo[102199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:20 devstack sudo[102199]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-76178401-bef7-4b20-b607-43e162ebad15" returned: 0 in 0.372s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:53:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73a7291-0062-4a2b-a178-8f80d08e4f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76178401-bef7-4b20-b607-43e162ebad15', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c9d8a5-8bbc-424c-bc55-791e12c33f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:20 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Volume volume-76178401-bef7-4b20-b607-43e162ebad15 (76178401-bef7-4b20-b607-43e162ebad15): created successfully Aug 09 12:53:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30c9d8a5-8bbc-424c-bc55-791e12c33f11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Flow 'volume_create_manager' (3a708014-8835-4354-b49a-ea80b24644b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:20 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-000fc606-28db-4843-86a4-f2d96876e671 tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Created volume successfully. Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Flow 'volume_create_manager' (00554aec-a47a-44f2-9eeb-d875618009f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4d7f9d-d9ea-4f65-9f6b-4add87deeaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd4d7f9d-d9ea-4f65-9f6b-4add87deeaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-487195897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88659d6a-7855-4bb9-b651-da3e3827586c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a58b93a46f44b2d971adfacaf44c21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:21Z,use_quota=True,user_id='0944784b46f44af9abf3cc38a2a18449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f8f58c-1d75-40ff-8485-efdb2cb93a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20f8f58c-1d75-40ff-8485-efdb2cb93a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc269afb-7c69-4d4f-afca-57749cfaf207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc269afb-7c69-4d4f-afca-57749cfaf207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '88659d6a-7855-4bb9-b651-da3e3827586c', 'volume_name': 'volume-88659d6a-7855-4bb9-b651-da3e3827586c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdd90f0-6da3-4c9b-b3e9-9f8d72510139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bdd90f0-6da3-4c9b-b3e9-9f8d72510139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54699ab4-97f9-402f-b88d-495ca7adeeb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:21 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Volume 88659d6a-7855-4bb9-b651-da3e3827586c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-88659d6a-7855-4bb9-b651-da3e3827586c', 'volume_size': 1} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-487195897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88659d6a-7855-4bb9-b651-da3e3827586c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a58b93a46f44b2d971adfacaf44c21f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:21Z,use_quota=True,user_id='0944784b46f44af9abf3cc38a2a18449',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Creating volume 88659d6a-7855-4bb9-b651-da3e3827586c {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:53:21 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:53:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-88659d6a-7855-4bb9-b651-da3e3827586c 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:21 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-88659d6a-7855-4bb9-b651-da3e3827586c 1073741824 Aug 09 12:53:21 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-40cb81b5-b01f-47cf-9780-9306c33a793a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-40cb81b5-b01f-47cf-9780-9306c33a793a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-40cb81b5-b01f-47cf-9780-9306c33a793a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-40cb81b5-b01f-47cf-9780-9306c33a793a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-40cb81b5-b01f-47cf-9780-9306c33a793a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-40cb81b5-b01f-47cf-9780-9306c33a793a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:22 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:53:22 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:22 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-88659d6a-7855-4bb9-b651-da3e3827586c 1073741824" returned: 0 in 0.782s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-88659d6a-7855-4bb9-b651-da3e3827586c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:22 devstack sudo[102211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-88659d6a-7855-4bb9-b651-da3e3827586c Aug 09 12:53:22 devstack sudo[102211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:22 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-40cb81b5-b01f-47cf-9780-9306c33a793a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.480s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-40cb81b5-b01f-47cf-9780-9306c33a793a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:53:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-40cb81b5-b01f-47cf-9780-9306c33a793a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Retype volume completed successfully. Aug 09 12:53:22 devstack sudo[102211]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-88659d6a-7855-4bb9-b651-da3e3827586c" returned: 0 in 0.339s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54699ab4-97f9-402f-b88d-495ca7adeeb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88659d6a-7855-4bb9-b651-da3e3827586c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb08ef5-7558-4d5f-bc7a-9ab7344bdf28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:22 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Volume volume-88659d6a-7855-4bb9-b651-da3e3827586c (88659d6a-7855-4bb9-b651-da3e3827586c): created successfully Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8cb08ef5-7558-4d5f-bc7a-9ab7344bdf28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Flow 'volume_create_manager' (00554aec-a47a-44f2-9eeb-d875618009f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8560b9e0-daf4-4111-a295-85b1180e349e tempest-VolumesTransfersV355Test-822310223 None] Created volume successfully. Aug 09 12:53:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Acquiring lock "cinder-76178401-bef7-4b20-b607-43e162ebad15-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Lock "cinder-76178401-bef7-4b20-b607-43e162ebad15-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Acquiring lock "cinder-quobyte-76178401-bef7-4b20-b607-43e162ebad15" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Lock "cinder-quobyte-76178401-bef7-4b20-b607-43e162ebad15" acquired by "delete_volume" :: waited 0.053s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:23 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ab010e-c026-4ede-acfd-b203da2ceaf2]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:53:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-76178401-bef7-4b20-b607-43e162ebad15 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:23 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-76178401-bef7-4b20-b607-43e162ebad15 Aug 09 12:53:23 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Acquiring lock "cinder-88659d6a-7855-4bb9-b651-da3e3827586c-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Lock "cinder-88659d6a-7855-4bb9-b651-da3e3827586c-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Acquiring lock "cinder-quobyte-88659d6a-7855-4bb9-b651-da3e3827586c" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Lock "cinder-quobyte-88659d6a-7855-4bb9-b651-da3e3827586c" acquired by "delete_volume" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:24 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0deb23dc-5b18-4eb1-aab7-b3ec83f214e1]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:53:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-88659d6a-7855-4bb9-b651-da3e3827586c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:24 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-76178401-bef7-4b20-b607-43e162ebad15" returned: 0 in 0.755s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-76178401-bef7-4b20-b607-43e162ebad15 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:24 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-76178401-bef7-4b20-b607-43e162ebad15 Aug 09 12:53:24 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:24 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-88659d6a-7855-4bb9-b651-da3e3827586c Aug 09 12:53:24 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:24 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:24 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-76178401-bef7-4b20-b607-43e162ebad15" returned: 0 in 0.427s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-88659d6a-7855-4bb9-b651-da3e3827586c" returned: 0 in 0.551s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-88659d6a-7855-4bb9-b651-da3e3827586c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Lock "cinder-quobyte-76178401-bef7-4b20-b607-43e162ebad15" released by "delete_volume" :: held 1.296s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:24 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-88659d6a-7855-4bb9-b651-da3e3827586c Aug 09 12:53:24 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:24 devstack cinder-volume[89309]: WARNING cinder.quota [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:53:24 devstack cinder-volume[89309]: WARNING cinder.quota [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:53:24 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Created reservations ['2125c218-91ff-4ead-9dcb-59458c6eb688', 'f04fb66d-6be5-4c38-bb4d-4e168272bfdd', '87edd506-dc1a-4556-b3d2-b3264b8a2ea1', '1c7833d8-9847-46c6-a2f1-d5b2b4512673'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:25 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:53:25 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:25 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-88659d6a-7855-4bb9-b651-da3e3827586c" returned: 0 in 0.316s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Lock "cinder-quobyte-88659d6a-7855-4bb9-b651-da3e3827586c" released by "delete_volume" :: held 0.928s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Created reservations ['45eaef90-8ca4-44bc-8abc-efeeffa52453', 'f11f9d0f-5c5b-45bd-b830-06ee7bfe8a70', '3de25b05-6f31-4c1d-89ef-b6a5979662f1', '23253a18-613f-4b48-a4ea-0a9f30d49860'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:53:25 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.335s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:53:25 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Deleted volume successfully. Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-100303e1-1e9c-410f-8609-eaf94e070c1a tempest-VolumeRetypeWithoutMigrationTest-14057180 None] Lock "cinder-76178401-bef7-4b20-b607-43e162ebad15-delete_volume" released by "delete_volume" :: held 1.996s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:25 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:53:25 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:25 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.287s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:53:25 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Deleted volume successfully. Aug 09 12:53:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c4420f25-796b-4f3f-a77e-4344885dc009 tempest-VolumesTransfersV355Test-1312171936 None] Lock "cinder-88659d6a-7855-4bb9-b651-da3e3827586c-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:35 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=82,cinder:INSERT=32,cinder:UPDATE=98,cinder:DELETE=9 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Flow 'volume_create_manager' (0517291d-207b-4a69-9fe7-1e6c803b7083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a8e4d2-f425-4ab1-b880-25b1ab2c6ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13a8e4d2-f425-4ab1-b880-25b1ab2c6ce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1253377525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663196e6-35d3-400e-8399-f088902966eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0bb5385c5744e7b933c8006bc686b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:38Z,use_quota=True,user_id='ffcad64566cf4f43bcb369c879bf0be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc22e0ea-c4ba-4a9a-b8f7-7672446d8f1a),volume_type_id=fc22e0ea-c4ba-4a9a-b8f7-7672446d8f1a)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ee470e-0a4e-49ed-b763-780d34a0f76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32ee470e-0a4e-49ed-b763-780d34a0f76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb712c2f-64b1-4038-bca0-fedcbf2c6ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb712c2f-64b1-4038-bca0-fedcbf2c6ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '663196e6-35d3-400e-8399-f088902966eb', 'volume_name': 'volume-663196e6-35d3-400e-8399-f088902966eb', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea29ad8-453d-4476-ba1d-99955908a1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ea29ad8-453d-4476-ba1d-99955908a1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685d8099-c2d8-44d6-954c-09f10d642c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:38 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Volume 663196e6-35d3-400e-8399-f088902966eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-663196e6-35d3-400e-8399-f088902966eb', 'volume_size': 1} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1253377525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=663196e6-35d3-400e-8399-f088902966eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f0bb5385c5744e7b933c8006bc686b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:38Z,use_quota=True,user_id='ffcad64566cf4f43bcb369c879bf0be1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fc22e0ea-c4ba-4a9a-b8f7-7672446d8f1a),volume_type_id=fc22e0ea-c4ba-4a9a-b8f7-7672446d8f1a)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Creating volume 663196e6-35d3-400e-8399-f088902966eb {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:53:38 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-663196e6-35d3-400e-8399-f088902966eb 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:38 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-663196e6-35d3-400e-8399-f088902966eb 1073741824 Aug 09 12:53:38 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:38 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-663196e6-35d3-400e-8399-f088902966eb 1073741824" returned: 0 in 0.695s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-663196e6-35d3-400e-8399-f088902966eb {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:38 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-663196e6-35d3-400e-8399-f088902966eb Aug 09 12:53:38 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Flow 'volume_create_manager' (558fc4f3-9859-4a53-9cc0-f352b10fdaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053a90db-42d7-45c7-8d11-6eee7a0b4163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (053a90db-42d7-45c7-8d11-6eee7a0b4163) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1213286947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9560bc74-a098-4cbb-8703-f733b6e26fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb350bf082e4582a59cf770de32ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:39Z,use_quota=True,user_id='cefa4df3bfd749f1b1d821bef383fca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ac5f60-d85e-4a03-8528-a54bf2fede96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20ac5f60-d85e-4a03-8528-a54bf2fede96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6e0637-65b9-49c8-bb25-9b39d95f9799) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df6e0637-65b9-49c8-bb25-9b39d95f9799) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9560bc74-a098-4cbb-8703-f733b6e26fbe', 'volume_name': 'volume-9560bc74-a098-4cbb-8703-f733b6e26fbe', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f647ac9d-5dc6-4352-bdae-df172abcda51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f647ac9d-5dc6-4352-bdae-df172abcda51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76205d5d-de6a-4e77-869c-3eb9fd492be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:39 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Volume 9560bc74-a098-4cbb-8703-f733b6e26fbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9560bc74-a098-4cbb-8703-f733b6e26fbe', 'volume_size': 1} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:39 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-663196e6-35d3-400e-8399-f088902966eb" returned: 0 in 0.330s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.089s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.130s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1213286947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9560bc74-a098-4cbb-8703-f733b6e26fbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb350bf082e4582a59cf770de32ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:39Z,use_quota=True,user_id='cefa4df3bfd749f1b1d821bef383fca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Creating volume 9560bc74-a098-4cbb-8703-f733b6e26fbe {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:53:39 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9560bc74-a098-4cbb-8703-f733b6e26fbe 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:39 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9560bc74-a098-4cbb-8703-f733b6e26fbe 1073741824 Aug 09 12:53:39 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-7505b9c9-c026-49b6-b005-b23314ba1537 req-88828457-afb1-4b4c-86e2-80fb9196a1a3 tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (685d8099-c2d8-44d6-954c-09f10d642c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-663196e6-35d3-400e-8399-f088902966eb', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b879a7-e8b8-4e2d-b2e5-6186af476e95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:39 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Volume volume-663196e6-35d3-400e-8399-f088902966eb (663196e6-35d3-400e-8399-f088902966eb): created successfully Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87b879a7-e8b8-4e2d-b2e5-6186af476e95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Flow 'volume_create_manager' (0517291d-207b-4a69-9fe7-1e6c803b7083) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:39 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-706e7d9b-67f8-4967-bcb1-f21c3fd73a6a tempest-VolumeTypesAccessTest-206020869 None] Created volume successfully. Aug 09 12:53:39 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9560bc74-a098-4cbb-8703-f733b6e26fbe 1073741824" returned: 0 in 0.553s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9560bc74-a098-4cbb-8703-f733b6e26fbe {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:39 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9560bc74-a098-4cbb-8703-f733b6e26fbe Aug 09 12:53:39 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:40 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9560bc74-a098-4cbb-8703-f733b6e26fbe" returned: 0 in 0.293s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-7505b9c9-c026-49b6-b005-b23314ba1537 req-88828457-afb1-4b4c-86e2-80fb9196a1a3 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.850s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-7505b9c9-c026-49b6-b005-b23314ba1537 req-88828457-afb1-4b4c-86e2-80fb9196a1a3 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76205d5d-de6a-4e77-869c-3eb9fd492be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9560bc74-a098-4cbb-8703-f733b6e26fbe', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e593d62-c0f9-4f58-b3b8-980a4dbf2346) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Acquiring lock "cinder-663196e6-35d3-400e-8399-f088902966eb-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:40 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Volume volume-9560bc74-a098-4cbb-8703-f733b6e26fbe (9560bc74-a098-4cbb-8703-f733b6e26fbe): created successfully Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e593d62-c0f9-4f58-b3b8-980a4dbf2346) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Flow 'volume_create_manager' (558fc4f3-9859-4a53-9cc0-f352b10fdaa2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Lock "cinder-663196e6-35d3-400e-8399-f088902966eb-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:40 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-bcd94d09-880a-4b4c-bb91-e56988718c62 tempest-VolumesTransfersV357Test-2000418230 None] Created volume successfully. Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-7505b9c9-c026-49b6-b005-b23314ba1537 req-88828457-afb1-4b4c-86e2-80fb9196a1a3 tempest-TestInstancesWithCinderVolumes-777629701 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16db8e8c-6a76-4eb7-8645-a937d0cd859a', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Acquiring lock "cinder-quobyte-663196e6-35d3-400e-8399-f088902966eb" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Lock "cinder-quobyte-663196e6-35d3-400e-8399-f088902966eb" acquired by "delete_volume" :: waited 0.032s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8c8862e-54a4-4ca4-a7bb-1f5bb1ef922d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-663196e6-35d3-400e-8399-f088902966eb {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:40 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-7505b9c9-c026-49b6-b005-b23314ba1537 req-88828457-afb1-4b4c-86e2-80fb9196a1a3 tempest-TestInstancesWithCinderVolumes-777629701 None] attachment_update completed successfully. Aug 09 12:53:40 devstack sudo[102353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-663196e6-35d3-400e-8399-f088902966eb Aug 09 12:53:40 devstack sudo[102353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:40 devstack sudo[102353]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-663196e6-35d3-400e-8399-f088902966eb" returned: 0 in 0.447s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-663196e6-35d3-400e-8399-f088902966eb {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:40 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-663196e6-35d3-400e-8399-f088902966eb Aug 09 12:53:40 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:41 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-663196e6-35d3-400e-8399-f088902966eb" returned: 0 in 0.384s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Lock "cinder-quobyte-663196e6-35d3-400e-8399-f088902966eb" released by "delete_volume" :: held 0.901s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:41 devstack cinder-volume[89309]: WARNING cinder.quota [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2009238313 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2009238313, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:53:41 devstack cinder-volume[89309]: WARNING cinder.quota [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2009238313 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2009238313, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:53:41 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Created reservations ['f95d7d1c-6f7f-400b-b67e-2deaa152500f', 'efe4e4e2-2876-4701-80a3-80cc775d57f9', 'c568063c-018e-402a-9e76-b86bc9674385', 'cad6bacd-3135-47e4-8138-9050215a7cbf'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:53:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:41 devstack sudo[102367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:53:41 devstack sudo[102367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:41 devstack sudo[102367]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.278s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:41 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:53:41 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Deleted volume successfully. Aug 09 12:53:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b966d392-c448-4688-a3da-0eeac24cb7d9 tempest-VolumeTypesAccessTest-206020869 None] Lock "cinder-663196e6-35d3-400e-8399-f088902966eb-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:41 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-fa237d7d-61bc-4f84-b9b3-93c744e9e0a0 tempest-VolumesTransfersV357Test-1502969282 None] Transfer volume completed successfully. Aug 09 12:53:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Acquiring lock "cinder-9560bc74-a098-4cbb-8703-f733b6e26fbe-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Lock "cinder-9560bc74-a098-4cbb-8703-f733b6e26fbe-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Acquiring lock "cinder-quobyte-9560bc74-a098-4cbb-8703-f733b6e26fbe" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Lock "cinder-quobyte-9560bc74-a098-4cbb-8703-f733b6e26fbe" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:42 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[47940edd-68cc-4361-9c53-85332cfdc38d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:53:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9560bc74-a098-4cbb-8703-f733b6e26fbe {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:42 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9560bc74-a098-4cbb-8703-f733b6e26fbe Aug 09 12:53:42 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:43 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9560bc74-a098-4cbb-8703-f733b6e26fbe" returned: 0 in 0.517s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9560bc74-a098-4cbb-8703-f733b6e26fbe {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:43 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9560bc74-a098-4cbb-8703-f733b6e26fbe Aug 09 12:53:43 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:43 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9560bc74-a098-4cbb-8703-f733b6e26fbe" returned: 0 in 0.381s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Lock "cinder-quobyte-9560bc74-a098-4cbb-8703-f733b6e26fbe" released by "delete_volume" :: held 0.957s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:43 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Created reservations ['f82cf1fb-1ae5-4552-b914-ada6e9f46dcd', '4eecbcce-3bbd-4b29-8273-80e3d5bdac86', 'b001ce4d-7ea4-471b-a4fa-3e6c7304eca7', 'ecbb9188-4287-4df5-bc20-13f3eadc3e68'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:53:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:43 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:53:43 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:44 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.326s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:44 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:53:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Deleted volume successfully. Aug 09 12:53:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-68de8973-3ba8-4920-9cca-f2eeb9a5a4eb tempest-VolumesTransfersV357Test-994213064 None] Lock "cinder-9560bc74-a098-4cbb-8703-f733b6e26fbe-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:44 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=110,cinder:UPDATE=118,cinder:INSERT=34,cinder:DELETE=7 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:53:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-5402d9ef-0220-437c-89f0-317d5bee03f3 req-c3c67814-8d78-42f4-a0c9-37075a27e03e tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-5402d9ef-0220-437c-89f0-317d5bee03f3 req-c3c67814-8d78-42f4-a0c9-37075a27e03e tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-5402d9ef-0220-437c-89f0-317d5bee03f3 req-c3c67814-8d78-42f4-a0c9-37075a27e03e tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-5402d9ef-0220-437c-89f0-317d5bee03f3 req-c3c67814-8d78-42f4-a0c9-37075a27e03e tempest-TestInstancesWithCinderVolumes-777629701 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-38938261-9d3e-442f-a921-24c7d93dc106', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fed6b703-86fd-4549-93bf-539ad89c7a4c', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:53:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-5402d9ef-0220-437c-89f0-317d5bee03f3 req-c3c67814-8d78-42f4-a0c9-37075a27e03e tempest-TestInstancesWithCinderVolumes-777629701 None] attachment_update completed successfully. Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Flow 'volume_create_manager' (7aa36bb3-5705-4251-b40a-55c649f5885b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5192763-2fc6-4958-b05b-e5131f81d6f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5192763-2fc6-4958-b05b-e5131f81d6f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-363097217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acda957-2b67-4f53-a016-e6f6140016ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb350bf082e4582a59cf770de32ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:45Z,use_quota=True,user_id='cefa4df3bfd749f1b1d821bef383fca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97bfa2c-6e6f-4531-8d2a-4e7a033b5b8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c97bfa2c-6e6f-4531-8d2a-4e7a033b5b8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eddce05-7266-4cd3-b5d0-74c1ece191ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0eddce05-7266-4cd3-b5d0-74c1ece191ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6acda957-2b67-4f53-a016-e6f6140016ee', 'volume_name': 'volume-6acda957-2b67-4f53-a016-e6f6140016ee', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90af140c-8c9f-4d55-b3bc-5e4c7eed18b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90af140c-8c9f-4d55-b3bc-5e4c7eed18b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7c42fe-4c93-49b6-a1dc-44402673ef7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:45 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Volume 6acda957-2b67-4f53-a016-e6f6140016ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6acda957-2b67-4f53-a016-e6f6140016ee', 'volume_size': 1} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-363097217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6acda957-2b67-4f53-a016-e6f6140016ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb350bf082e4582a59cf770de32ceaf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:45Z,use_quota=True,user_id='cefa4df3bfd749f1b1d821bef383fca5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Creating volume 6acda957-2b67-4f53-a016-e6f6140016ee {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:53:45 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:53:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6acda957-2b67-4f53-a016-e6f6140016ee 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:45 devstack sudo[102403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6acda957-2b67-4f53-a016-e6f6140016ee 1073741824 Aug 09 12:53:45 devstack sudo[102403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:46 devstack sudo[102403]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6acda957-2b67-4f53-a016-e6f6140016ee 1073741824" returned: 0 in 0.763s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6acda957-2b67-4f53-a016-e6f6140016ee {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:46 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6acda957-2b67-4f53-a016-e6f6140016ee Aug 09 12:53:46 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:46 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6acda957-2b67-4f53-a016-e6f6140016ee" returned: 0 in 0.443s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:53:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc7c42fe-4c93-49b6-a1dc-44402673ef7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6acda957-2b67-4f53-a016-e6f6140016ee', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e55ffc-2081-4d04-b1b9-c9ccaed27a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:46 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Volume volume-6acda957-2b67-4f53-a016-e6f6140016ee (6acda957-2b67-4f53-a016-e6f6140016ee): created successfully Aug 09 12:53:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e55ffc-2081-4d04-b1b9-c9ccaed27a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Flow 'volume_create_manager' (7aa36bb3-5705-4251-b40a-55c649f5885b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:46 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-16cbfd03-9cc9-474b-9391-ffa9bb7312c5 tempest-VolumesTransfersV357Test-2000418230 None] Created volume successfully. Aug 09 12:53:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Acquiring lock "cinder-6acda957-2b67-4f53-a016-e6f6140016ee-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Lock "cinder-6acda957-2b67-4f53-a016-e6f6140016ee-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Acquiring lock "cinder-quobyte-6acda957-2b67-4f53-a016-e6f6140016ee" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Lock "cinder-quobyte-6acda957-2b67-4f53-a016-e6f6140016ee" acquired by "delete_volume" :: waited 0.034s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:48 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1efcbd5-6814-460a-9177-e094bf3a13f4]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:53:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6acda957-2b67-4f53-a016-e6f6140016ee {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:48 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6acda957-2b67-4f53-a016-e6f6140016ee Aug 09 12:53:48 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:48 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6acda957-2b67-4f53-a016-e6f6140016ee" returned: 0 in 0.493s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6acda957-2b67-4f53-a016-e6f6140016ee {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:48 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6acda957-2b67-4f53-a016-e6f6140016ee Aug 09 12:53:48 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:48 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6acda957-2b67-4f53-a016-e6f6140016ee" returned: 0 in 0.314s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Lock "cinder-quobyte-6acda957-2b67-4f53-a016-e6f6140016ee" released by "delete_volume" :: held 0.863s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:49 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Created reservations ['7cafdd7d-267c-4560-b07c-e779ea6eebed', 'b157d8ff-2552-4b6b-ad43-99a281d1bbd5', '7ad4ad5b-ea25-4cc7-8e66-c96e54b69a04', 'e3c3e3db-407e-4502-9b5f-f21399eced6a'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:53:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:49 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:53:49 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:49 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.359s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:49 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:53:49 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Deleted volume successfully. Aug 09 12:53:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e39d8222-ba81-4528-9760-8f9024980874 tempest-VolumesTransfersV357Test-994213064 None] Lock "cinder-6acda957-2b67-4f53-a016-e6f6140016ee-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:51 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-1440a690-f031-4e16-b5ff-4bb25f2be0d8 req-fc838deb-79c4-4ad9-be41-4923cda70315 tempest-TestInstancesWithCinderVolumes-777629701 None] Terminate volume connection completed successfully. Aug 09 12:53:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-1440a690-f031-4e16-b5ff-4bb25f2be0d8 req-fc838deb-79c4-4ad9-be41-4923cda70315 tempest-TestInstancesWithCinderVolumes-777629701 None] Deleting attachment 16db8e8c-6a76-4eb7-8645-a937d0cd859a. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:53:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "cinder-b03f3750-d133-4c56-aec6-bdbd2dc68e30-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "cinder-b03f3750-d133-4c56-aec6-bdbd2dc68e30-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "cinder-quobyte-b03f3750-d133-4c56-aec6-bdbd2dc68e30" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "cinder-quobyte-b03f3750-d133-4c56-aec6-bdbd2dc68e30" acquired by "delete_volume" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:51 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6f283d-f77f-46eb-a9d8-efbf6571929e]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:53:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:52 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30 Aug 09 12:53:52 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:52 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30" returned: 0 in 0.753s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:52 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30 Aug 09 12:53:52 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:53 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b03f3750-d133-4c56-aec6-bdbd2dc68e30" returned: 0 in 0.468s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "cinder-quobyte-b03f3750-d133-4c56-aec6-bdbd2dc68e30" released by "delete_volume" :: held 1.324s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:53 devstack cinder-volume[89309]: WARNING cinder.quota [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-131811051-174180821 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-131811051-174180821, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:53:53 devstack cinder-volume[89309]: WARNING cinder.quota [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-131811051-174180821 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-131811051-174180821, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:53:53 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Created reservations ['cda5c096-b4d7-4796-b4a6-5f1161bf0bf1', '18ca2a00-d1a6-44c4-b8fb-f41f56e255e2', '63f8831f-c20d-4c3e-a53b-49e0908f57bc', '226f960a-e045-4c59-9d93-fb4bb8096c8c'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:53:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:53 devstack sudo[102490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:53:53 devstack sudo[102490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:53 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:53:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Flow 'volume_create_manager' (40bb2bb8-e865-479c-a0a6-1f87f9d8756a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6523ddb-3b70-4ceb-8840-14e8550aab99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6523ddb-3b70-4ceb-8840-14e8550aab99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1520607019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef813f7d-abb1-43b4-962c-c7962b0788c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d509c8eae4414282963deb570a6f46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:54Z,use_quota=True,user_id='9c8c3a0c08534a3caa9842ad43955eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:54 devstack sudo[102490]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7fdffb-ab72-47e9-a95e-ff9ef68627bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e7fdffb-ab72-47e9-a95e-ff9ef68627bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2269a334-75ee-407d-975e-bc2f421ce1eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2269a334-75ee-407d-975e-bc2f421ce1eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef813f7d-abb1-43b4-962c-c7962b0788c1', 'volume_name': 'volume-ef813f7d-abb1-43b4-962c-c7962b0788c1', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598f4fa0-10c9-4206-a32f-5e39cf544dd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (598f4fa0-10c9-4206-a32f-5e39cf544dd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c07bf3-3da1-4239-983d-a301f6e19b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:54 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Volume ef813f7d-abb1-43b4-962c-c7962b0788c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef813f7d-abb1-43b4-962c-c7962b0788c1', 'volume_size': 1} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1520607019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef813f7d-abb1-43b4-962c-c7962b0788c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d509c8eae4414282963deb570a6f46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:54Z,use_quota=True,user_id='9c8c3a0c08534a3caa9842ad43955eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Creating volume ef813f7d-abb1-43b4-962c-c7962b0788c1 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:53:54 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ef813f7d-abb1-43b4-962c-c7962b0788c1 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.642s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:53:54 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Deleted volume successfully. Aug 09 12:53:54 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ef813f7d-abb1-43b4-962c-c7962b0788c1 1073741824 Aug 09 12:53:54 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c8a0baca-dae1-431b-971f-21add7e564a1 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "cinder-b03f3750-d133-4c56-aec6-bdbd2dc68e30-delete_volume" released by "delete_volume" :: held 2.339s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:54 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ef813f7d-abb1-43b4-962c-c7962b0788c1 1073741824" returned: 0 in 0.721s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ef813f7d-abb1-43b4-962c-c7962b0788c1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:54 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ef813f7d-abb1-43b4-962c-c7962b0788c1 Aug 09 12:53:54 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:55 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ef813f7d-abb1-43b4-962c-c7962b0788c1" returned: 0 in 0.328s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] <== create_volume: return (1101ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:53:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.105s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8c07bf3-3da1-4239-983d-a301f6e19b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef813f7d-abb1-43b4-962c-c7962b0788c1', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecc1259-5921-4534-98cf-64f6eb01318a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:55 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Volume volume-ef813f7d-abb1-43b4-962c-c7962b0788c1 (ef813f7d-abb1-43b4-962c-c7962b0788c1): created successfully Aug 09 12:53:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ecc1259-5921-4534-98cf-64f6eb01318a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Flow 'volume_create_manager' (40bb2bb8-e865-479c-a0a6-1f87f9d8756a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:55 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-05703feb-9b5b-416e-9b79-6fb9899e810f tempest-VolumesListAdminTestJSON-821363528 None] Created volume successfully. Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Flow 'volume_create_manager' (a9cc824e-09fd-415f-a0e5-3d9da9b63d29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db28fc8-205f-4c25-8315-085ad231c0c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db28fc8-205f-4c25-8315-085ad231c0c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1919688649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5d819b-32ac-4aed-8970-d877463edb7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d509c8eae4414282963deb570a6f46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:57Z,use_quota=True,user_id='9c8c3a0c08534a3caa9842ad43955eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114f4414-1b52-4e0d-b373-579cac5d23e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (114f4414-1b52-4e0d-b373-579cac5d23e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5467b670-e7e4-438b-8e08-e39c8897f95d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5467b670-e7e4-438b-8e08-e39c8897f95d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e5d819b-32ac-4aed-8970-d877463edb7f', 'volume_name': 'volume-0e5d819b-32ac-4aed-8970-d877463edb7f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a0a21f-bf27-4f48-a094-51ba44f14c2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1a0a21f-bf27-4f48-a094-51ba44f14c2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175c4fda-1af4-48d7-9901-3767eb8cc538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:56 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Volume 0e5d819b-32ac-4aed-8970-d877463edb7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e5d819b-32ac-4aed-8970-d877463edb7f', 'volume_size': 1} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1919688649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e5d819b-32ac-4aed-8970-d877463edb7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d509c8eae4414282963deb570a6f46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:57Z,use_quota=True,user_id='9c8c3a0c08534a3caa9842ad43955eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Creating volume 0e5d819b-32ac-4aed-8970-d877463edb7f {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:53:56 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:53:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e5d819b-32ac-4aed-8970-d877463edb7f 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:56 devstack sudo[102541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e5d819b-32ac-4aed-8970-d877463edb7f 1073741824 Aug 09 12:53:56 devstack sudo[102541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:57 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-e471a363-7d23-4787-9518-609f24f1c2b6 req-6b2e9e1b-9038-49b5-8ce0-0cb0d4cd8a23 tempest-TestInstancesWithCinderVolumes-777629701 None] Terminate volume connection completed successfully. Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-e471a363-7d23-4787-9518-609f24f1c2b6 req-6b2e9e1b-9038-49b5-8ce0-0cb0d4cd8a23 tempest-TestInstancesWithCinderVolumes-777629701 None] Deleting attachment fed6b703-86fd-4549-93bf-539ad89c7a4c. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "cinder-38938261-9d3e-442f-a921-24c7d93dc106-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "cinder-38938261-9d3e-442f-a921-24c7d93dc106-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:57 devstack sudo[102541]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e5d819b-32ac-4aed-8970-d877463edb7f 1073741824" returned: 0 in 0.625s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "cinder-quobyte-38938261-9d3e-442f-a921-24c7d93dc106" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e5d819b-32ac-4aed-8970-d877463edb7f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "cinder-quobyte-38938261-9d3e-442f-a921-24c7d93dc106" acquired by "delete_volume" :: waited 0.057s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:57 devstack sudo[102551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e5d819b-32ac-4aed-8970-d877463edb7f Aug 09 12:53:57 devstack sudo[102551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a18d071-2edf-4c68-a84a-c4c16a7de2de]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:53:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-38938261-9d3e-442f-a921-24c7d93dc106 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:57 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:53:57 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:58 devstack sudo[102564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-38938261-9d3e-442f-a921-24c7d93dc106 Aug 09 12:53:58 devstack sudo[102564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:58 devstack sudo[102551]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e5d819b-32ac-4aed-8970-d877463edb7f" returned: 0 in 0.907s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] <== create_volume: return (1660ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.663s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (175c4fda-1af4-48d7-9901-3767eb8cc538) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e5d819b-32ac-4aed-8970-d877463edb7f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77d259b-3f11-481d-bd31-2a8e317d8aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:58 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Volume volume-0e5d819b-32ac-4aed-8970-d877463edb7f (0e5d819b-32ac-4aed-8970-d877463edb7f): created successfully Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d77d259b-3f11-481d-bd31-2a8e317d8aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Flow 'volume_create_manager' (a9cc824e-09fd-415f-a0e5-3d9da9b63d29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:58 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-59dd92ad-1b67-4f8f-9272-2693b1ce0a4c tempest-VolumesListAdminTestJSON-821363528 None] Created volume successfully. Aug 09 12:53:58 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.872s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:53:58 devstack sudo[102564]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-38938261-9d3e-442f-a921-24c7d93dc106" returned: 0 in 1.077s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-38938261-9d3e-442f-a921-24c7d93dc106 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:59 devstack sudo[102612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-38938261-9d3e-442f-a921-24c7d93dc106 Aug 09 12:53:59 devstack sudo[102612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Flow 'volume_create_manager' (b7f337c8-1175-4292-a2b3-b436e3647bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68cde17b-6ef7-4a05-8187-74e4f4615d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (68cde17b-6ef7-4a05-8187-74e4f4615d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1256570589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed15d40-2529-4ed8-9524-2bcfd6bece5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4cfc9310914673924d8955c0762bf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:59Z,use_quota=True,user_id='d67bcfa792e74796abb275ac66d4e38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a62e3e-d6b0-4017-a5b7-d0bdce5796d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78a62e3e-d6b0-4017-a5b7-d0bdce5796d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe616a8c-c35a-43a3-865b-acf5adad53f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.image.glance [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Creating Keystone auth plugin from conf {{(pid=89309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 12:53:59 devstack sudo[102612]: pam_unix(sudo:session): session closed for user root Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-38938261-9d3e-442f-a921-24c7d93dc106" returned: 0 in 0.424s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "cinder-quobyte-38938261-9d3e-442f-a921-24c7d93dc106" released by "delete_volume" :: held 1.765s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:53:59 devstack cinder-volume[89309]: WARNING cinder.quota [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1988750322-1785917830 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1988750322-1785917830, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:53:59 devstack cinder-volume[89309]: WARNING cinder.quota [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1988750322-1785917830 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1988750322-1785917830, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Created reservations ['cb087557-6468-4848-905f-06ff785550d5', 'cc48f627-7073-42d4-9c2c-34e0d7ffb741', '08c151c4-5746-4d6c-b656-27eaf42d402f', '61fea1e4-23cf-4138-a201-0d68bb4d55c0'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:53:59 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:53:59 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe616a8c-c35a-43a3-865b-acf5adad53f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fed15d40-2529-4ed8-9524-2bcfd6bece5d', 'volume_name': 'volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8ae3a4-36d3-4921-99a6-ad3971cee692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c8ae3a4-36d3-4921-99a6-ad3971cee692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3eba5cb-fd9c-45e8-8783-0813293bf98a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:53:59 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Volume fed15d40-2529-4ed8-9524-2bcfd6bece5d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Trying to clone fed15d40-2529-4ed8-9524-2bcfd6bece5d from image edd103c7-208a-494c-8e8e-975b743b3cc4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]). {{(pid=89309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:53:59 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Flow 'volume_create_manager' (00707da5-56cb-4d3c-ae73-66169e0cac12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453639a8-84fe-4c1e-b918-5cae0c9ad7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453639a8-84fe-4c1e-b918-5cae0c9ad7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1305553972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0011ecc-7711-4c48-89d0-fc4272238b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d509c8eae4414282963deb570a6f46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:00Z,use_quota=True,user_id='9c8c3a0c08534a3caa9842ad43955eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e216dfe-63bf-4413-a1ab-a565a37ea412) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e216dfe-63bf-4413-a1ab-a565a37ea412) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdeb4ce-fa2b-4a06-86dc-080b40b93433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fdeb4ce-fa2b-4a06-86dc-080b40b93433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0011ecc-7711-4c48-89d0-fc4272238b57', 'volume_name': 'volume-f0011ecc-7711-4c48-89d0-fc4272238b57', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a103ce4a-6476-4cac-abb2-6de7b3a1bda9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a103ce4a-6476-4cac-abb2-6de7b3a1bda9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54823749-fb62-4890-9dac-3be0f4a0e096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:00 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Volume f0011ecc-7711-4c48-89d0-fc4272238b57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0011ecc-7711-4c48-89d0-fc4272238b57', 'volume_size': 1} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1305553972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0011ecc-7711-4c48-89d0-fc4272238b57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d509c8eae4414282963deb570a6f46e5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:00Z,use_quota=True,user_id='9c8c3a0c08534a3caa9842ad43955eb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Creating volume f0011ecc-7711-4c48-89d0-fc4272238b57 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:54:00 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0011ecc-7711-4c48-89d0-fc4272238b57 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:00 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0011ecc-7711-4c48-89d0-fc4272238b57 1073741824 Aug 09 12:54:00 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:00 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.611s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:00 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Deleted volume successfully. Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-97ee1cc7-3968-434b-8bbe-d223afec45b9 tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "cinder-38938261-9d3e-442f-a921-24c7d93dc106-delete_volume" released by "delete_volume" :: held 2.950s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 12:54:00 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Image download 20.69 MB at 20.69 MB/s Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f58f5b-b039-4c49-9579-79efa955be22]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:00 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD Aug 09 12:54:00 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:00 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0011ecc-7711-4c48-89d0-fc4272238b57 1073741824" returned: 0 in 0.791s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0011ecc-7711-4c48-89d0-fc4272238b57 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:01 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0011ecc-7711-4c48-89d0-fc4272238b57 Aug 09 12:54:01 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:01 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD" returned: 0 in 0.446s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:01 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Temporary image edd103c7-208a-494c-8e8e-975b743b3cc4 is fetched for user d67bcfa792e74796abb275ac66d4e38d. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 12:54:01 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[314f7774-9569-4bf4-a3d0-ec585839c0fa]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:01 devstack sudo[102665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD Aug 09 12:54:01 devstack sudo[102665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:01 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0011ecc-7711-4c48-89d0-fc4272238b57" returned: 0 in 0.704s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:54:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54823749-fb62-4890-9dac-3be0f4a0e096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0011ecc-7711-4c48-89d0-fc4272238b57', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e2bb0d-1b2e-4494-8b93-c848b63b5b05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:01 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Volume volume-f0011ecc-7711-4c48-89d0-fc4272238b57 (f0011ecc-7711-4c48-89d0-fc4272238b57): created successfully Aug 09 12:54:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2e2bb0d-1b2e-4494-8b93-c848b63b5b05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Flow 'volume_create_manager' (00707da5-56cb-4d3c-ae73-66169e0cac12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:01 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c4d781b1-60bf-4d22-bbf3-66695e856716 tempest-VolumesListAdminTestJSON-821363528 None] Created volume successfully. Aug 09 12:54:02 devstack sudo[102665]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD" returned: 0 in 0.760s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1256570589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fed15d40-2529-4ed8-9524-2bcfd6bece5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4cfc9310914673924d8955c0762bf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:53:59Z,use_quota=True,user_id='d67bcfa792e74796abb275ac66d4e38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:54:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Creating volume fed15d40-2529-4ed8-9524-2bcfd6bece5d {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:54:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:54:02 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:54:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:02 devstack sudo[102671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d 1073741824 Aug 09 12:54:02 devstack sudo[102671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:03 devstack sudo[102671]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d 1073741824" returned: 0 in 0.989s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:03 devstack sudo[102679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d Aug 09 12:54:03 devstack sudo[102679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:03 devstack sudo[102679]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d" returned: 0 in 0.525s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] <== create_volume: return (1606ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:54:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.612s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:03 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Attempting download of edd103c7-208a-494c-8e8e-975b743b3cc4 ((None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}])) to volume fed15d40-2529-4ed8-9524-2bcfd6bece5d. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 12:54:03 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b49cae0-12fc-4bab-8b42-a727c3fa0372]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_7kgvihim {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:03 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:54:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Flow 'volume_create_manager' (28272f66-1cb9-4390-bd50-11d6c5bc4a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1fd095-aeb9-4afe-a1de-fbef3f577390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b1fd095-aeb9-4afe-a1de-fbef3f577390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245c974e-c6da-4150-9499-ac8983fab8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a53214a6b4c10bf99ae3d820b5cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:04Z,use_quota=True,user_id='bc290a995b474357ab5edeb493cd9b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:04 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_7kgvihim Aug 09 12:54:04 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b252c8-f032-4b7c-8b4c-4095c925d415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b252c8-f032-4b7c-8b4c-4095c925d415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1645ca6-59cd-4c6d-9382-6d8d331d6ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1645ca6-59cd-4c6d-9382-6d8d331d6ebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '245c974e-c6da-4150-9499-ac8983fab8d6', 'volume_name': 'volume-245c974e-c6da-4150-9499-ac8983fab8d6', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12469159-d931-4d44-9df9-2b407b032ecc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12469159-d931-4d44-9df9-2b407b032ecc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2589e00a-5040-42c2-ad29-4c88de906b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:04 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Volume 245c974e-c6da-4150-9499-ac8983fab8d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-245c974e-c6da-4150-9499-ac8983fab8d6', 'volume_size': 1} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:03Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=245c974e-c6da-4150-9499-ac8983fab8d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec2a53214a6b4c10bf99ae3d820b5cfc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:04Z,use_quota=True,user_id='bc290a995b474357ab5edeb493cd9b46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Creating volume 245c974e-c6da-4150-9499-ac8983fab8d6 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:54:04 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-245c974e-c6da-4150-9499-ac8983fab8d6 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:04 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-245c974e-c6da-4150-9499-ac8983fab8d6 1073741824 Aug 09 12:54:04 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:04 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_7kgvihim" returned: 0 in 0.998s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_7kgvihim {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:04 devstack sudo[102715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_7kgvihim Aug 09 12:54:05 devstack sudo[102715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:05 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-245c974e-c6da-4150-9499-ac8983fab8d6 1073741824" returned: 0 in 0.945s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-245c974e-c6da-4150-9499-ac8983fab8d6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:05 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-245c974e-c6da-4150-9499-ac8983fab8d6 Aug 09 12:54:05 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:05 devstack sudo[102715]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_7kgvihim" returned: 1 in 0.538s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_7kgvihim' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:54:05 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0ac12af-6373-468f-8844-dca52cd345e2]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:05 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-245c974e-c6da-4150-9499-ac8983fab8d6" returned: 0 in 0.515s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:05 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:54:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.569s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:05 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD Aug 09 12:54:05 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2589e00a-5040-42c2-ad29-4c88de906b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-245c974e-c6da-4150-9499-ac8983fab8d6', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90837464-2734-402f-af55-4652c07ad0a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:05 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Volume volume-245c974e-c6da-4150-9499-ac8983fab8d6 (245c974e-c6da-4150-9499-ac8983fab8d6): created successfully Aug 09 12:54:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90837464-2734-402f-af55-4652c07ad0a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Flow 'volume_create_manager' (28272f66-1cb9-4390-bd50-11d6c5bc4a7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e6d1f4c6-e97d-4f9e-bc75-60c0726dac2c tempest-VolumesListAdminTestJSON-2068729411 None] Created volume successfully. Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Acquiring lock "cinder-245c974e-c6da-4150-9499-ac8983fab8d6-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:06 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-8ba76765-5ff8-494b-8e56-b129abc8f10a req-a1b6cc36-4db1-48f8-9b5a-4f96673f64d7 tempest-TestInstancesWithCinderVolumes-777629701 None] Terminate volume connection completed successfully. Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-8ba76765-5ff8-494b-8e56-b129abc8f10a req-a1b6cc36-4db1-48f8-9b5a-4f96673f64d7 tempest-TestInstancesWithCinderVolumes-777629701 None] Deleting attachment 30e99449-ac30-48ed-8b0f-b84661fb45cf. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:54:06 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD" returned: 0 in 0.859s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] edd103c7-208a-494c-8e8e-975b743b3cc4 was qcow2, converting to qcow2 {{(pid=89309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Lock "cinder-245c974e-c6da-4150-9499-ac8983fab8d6-delete_volume" acquired by "delete_volume" :: waited 0.109s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:06 devstack sudo[102731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d Aug 09 12:54:06 devstack sudo[102731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "cinder-f0011ecc-7711-4c48-89d0-fc4272238b57-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Acquiring lock "cinder-quobyte-245c974e-c6da-4150-9499-ac8983fab8d6" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Lock "cinder-quobyte-245c974e-c6da-4150-9499-ac8983fab8d6" acquired by "delete_volume" :: waited 0.046s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Lock "cinder-f0011ecc-7711-4c48-89d0-fc4272238b57-delete_volume" acquired by "delete_volume" :: waited 0.094s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b83e9653-1d9a-456c-a3a3-d7d3622d2622]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-245c974e-c6da-4150-9499-ac8983fab8d6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "cinder-quobyte-f0011ecc-7711-4c48-89d0-fc4272238b57" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Lock "cinder-quobyte-f0011ecc-7711-4c48-89d0-fc4272238b57" acquired by "delete_volume" :: waited 0.034s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e500bcef-9b62-4268-afd8-e8ab5adde50d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0011ecc-7711-4c48-89d0-fc4272238b57 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:06 devstack sudo[102733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-245c974e-c6da-4150-9499-ac8983fab8d6 Aug 09 12:54:06 devstack sudo[102733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:06 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0011ecc-7711-4c48-89d0-fc4272238b57 Aug 09 12:54:06 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:07 devstack sudo[102733]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-245c974e-c6da-4150-9499-ac8983fab8d6" returned: 0 in 0.640s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-245c974e-c6da-4150-9499-ac8983fab8d6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:07 devstack sudo[102746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-245c974e-c6da-4150-9499-ac8983fab8d6 Aug 09 12:54:07 devstack sudo[102746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:07 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0011ecc-7711-4c48-89d0-fc4272238b57" returned: 0 in 0.720s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0011ecc-7711-4c48-89d0-fc4272238b57 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:07 devstack sudo[102753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0011ecc-7711-4c48-89d0-fc4272238b57 Aug 09 12:54:07 devstack sudo[102753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:07 devstack sudo[102746]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-245c974e-c6da-4150-9499-ac8983fab8d6" returned: 0 in 0.487s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Lock "cinder-quobyte-245c974e-c6da-4150-9499-ac8983fab8d6" released by "delete_volume" :: held 1.208s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Created reservations ['4c7a0146-2d68-48ba-b1aa-ea1fe465ea28', '5a71cec5-1c40-4eb9-8da7-9a4f63098a3b', 'aa640319-6e2c-46d9-8995-88d40d1ccda5', 'e8639bc4-58a8-42b7-b143-5860d9a7cc41'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:07 devstack sudo[102753]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0011ecc-7711-4c48-89d0-fc4272238b57" returned: 0 in 0.478s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:07 devstack sudo[102757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:07 devstack sudo[102757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Lock "cinder-quobyte-f0011ecc-7711-4c48-89d0-fc4272238b57" released by "delete_volume" :: held 1.268s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:07 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Created reservations ['9176bcfd-311b-4b67-b126-bbe6b4740cf1', '215d4691-a60f-4e2e-8941-955596249866', '7ea9ca00-b134-4ea7-bbc6-97bcbb1f1677', '34ed9cae-acc1-4aaa-b4d8-97693a14064e'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:08 devstack sudo[102759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:08 devstack sudo[102759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:08 devstack sudo[102757]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.362s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:08 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Deleted volume successfully. Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b439c952-a3d1-4607-ba33-324c2e310492 tempest-VolumesListAdminTestJSON-2068729411 None] Lock "cinder-245c974e-c6da-4150-9499-ac8983fab8d6-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:08 devstack sudo[102759]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.346s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:08 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Deleted volume successfully. Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e5a2c5f7-0fcd-4c7f-b6b6-48824687db99 tempest-VolumesListAdminTestJSON-821363528 None] Lock "cinder-f0011ecc-7711-4c48-89d0-fc4272238b57-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "cinder-d6c15da7-2e88-47cb-94c1-a22ab6632342-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "cinder-d6c15da7-2e88-47cb-94c1-a22ab6632342-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "cinder-quobyte-d6c15da7-2e88-47cb-94c1-a22ab6632342" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "cinder-quobyte-d6c15da7-2e88-47cb-94c1-a22ab6632342" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d37f0706-ede0-43a7-b5a0-3f86727f72e1]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "cinder-0e5d819b-32ac-4aed-8970-d877463edb7f-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Lock "cinder-0e5d819b-32ac-4aed-8970-d877463edb7f-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "cinder-quobyte-0e5d819b-32ac-4aed-8970-d877463edb7f" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Lock "cinder-quobyte-0e5d819b-32ac-4aed-8970-d877463edb7f" acquired by "delete_volume" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7aef2af-5e7e-4aec-9222-b86c141f3b81]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e5d819b-32ac-4aed-8970-d877463edb7f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:09 devstack sudo[102763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 Aug 09 12:54:09 devstack sudo[102763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:09 devstack sudo[102731]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d" returned: 0 in 2.767s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_ivk1zjsldevstack@QuobyteHD, size 112.00 MB, duration 2.77 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:54:09 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Converted 112.00 MB image at 40.45 MB/s Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:09 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d 1G Aug 09 12:54:09 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:09 devstack sudo[102764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e5d819b-32ac-4aed-8970-d877463edb7f Aug 09 12:54:09 devstack sudo[102764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:09 devstack sudo[102763]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342" returned: 0 in 0.540s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:09 devstack sudo[102776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342 Aug 09 12:54:09 devstack sudo[102776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:09 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d 1G" returned: 0 in 0.409s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Downloaded image edd103c7-208a-494c-8e8e-975b743b3cc4 ((None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}])) to volume fed15d40-2529-4ed8-9524-2bcfd6bece5d successfully. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Temporary image edd103c7-208a-494c-8e8e-975b743b3cc4 for user d67bcfa792e74796abb275ac66d4e38d is deleted. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Marking volume fed15d40-2529-4ed8-9524-2bcfd6bece5d as bootable. {{(pid=89309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Copying metadata from image edd103c7-208a-494c-8e8e-975b743b3cc4 to fed15d40-2529-4ed8-9524-2bcfd6bece5d. {{(pid=89309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Creating volume glance metadata for volume fed15d40-2529-4ed8-9524-2bcfd6bece5d backed by image edd103c7-208a-494c-8e8e-975b743b3cc4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 12:54:09 devstack sudo[102764]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e5d819b-32ac-4aed-8970-d877463edb7f" returned: 0 in 0.538s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e5d819b-32ac-4aed-8970-d877463edb7f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:09 devstack sudo[102782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e5d819b-32ac-4aed-8970-d877463edb7f Aug 09 12:54:09 devstack sudo[102782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3eba5cb-fd9c-45e8-8783-0813293bf98a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022fe32c-0c60-42d2-a5cc-f58d5af1042e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:09 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Volume volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d (fed15d40-2529-4ed8-9524-2bcfd6bece5d): created successfully Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022fe32c-0c60-42d2-a5cc-f58d5af1042e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Flow 'volume_create_manager' (b7f337c8-1175-4292-a2b3-b436e3647bb9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:09 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-157e7fe2-58fe-4ee1-98ba-b9008e3ce716 tempest-VolumesExtendTest-2099569029 None] Created volume successfully. Aug 09 12:54:09 devstack sudo[102776]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d6c15da7-2e88-47cb-94c1-a22ab6632342" returned: 0 in 0.365s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "cinder-quobyte-d6c15da7-2e88-47cb-94c1-a22ab6632342" released by "delete_volume" :: held 0.960s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:09 devstack cinder-volume[89309]: WARNING cinder.quota [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1765589291-1410302965 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1765589291-1410302965, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:54:09 devstack cinder-volume[89309]: WARNING cinder.quota [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1765589291-1410302965 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1765589291-1410302965, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Created reservations ['0f33b0c2-d31e-4bd9-9d38-eee0c5bb053b', 'b29714b0-b36a-4386-a1bc-1bd90364a62c', '4c9e3ede-8ff7-4b21-b877-80e85574809e', 'f2cb634f-010d-47f0-980e-3eebf613753b'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:09 devstack sudo[102782]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0e5d819b-32ac-4aed-8970-d877463edb7f" returned: 0 in 0.274s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Lock "cinder-quobyte-0e5d819b-32ac-4aed-8970-d877463edb7f" released by "delete_volume" :: held 0.861s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:09 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Created reservations ['f3eeb3c9-2b9f-4940-ac4d-56d3d8de0500', 'defe3106-e4ef-413d-844f-1de4f88a7f46', '66474d52-0795-4cfd-82b3-6dd67ee1a867', '77875cf5-7d45-420b-bc26-1457f7369af9'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:09 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:09 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:10 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:10 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "cinder-ef813f7d-abb1-43b4-962c-c7962b0788c1-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Lock "cinder-ef813f7d-abb1-43b4-962c-c7962b0788c1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:10 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "cinder-quobyte-ef813f7d-abb1-43b4-962c-c7962b0788c1" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.411s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:10 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Deleted volume successfully. Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Lock "cinder-quobyte-ef813f7d-abb1-43b4-962c-c7962b0788c1" acquired by "delete_volume" :: waited 0.035s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:10 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.345s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[20499b54-40d3-4225-801c-2b2a5ede274e]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ef813f7d-abb1-43b4-962c-c7962b0788c1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:10 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Deleted volume successfully. Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6da09a1c-2c88-4dde-84b1-3575917061cd tempest-TestInstancesWithCinderVolumes-777629701 None] Lock "cinder-d6c15da7-2e88-47cb-94c1-a22ab6632342-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8518515b-4c21-40e5-a248-359572586cd7 tempest-VolumesListAdminTestJSON-821363528 None] Lock "cinder-0e5d819b-32ac-4aed-8970-d877463edb7f-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:10 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ef813f7d-abb1-43b4-962c-c7962b0788c1 Aug 09 12:54:10 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-def2e9de-1d81-48f4-a20e-732c2480a408 tempest-VolumesExtendTest-2099569029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-def2e9de-1d81-48f4-a20e-732c2480a408 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7875c45-2c2c-44e2-aab0-af56caf285e5]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-def2e9de-1d81-48f4-a20e-732c2480a408 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:10 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d Aug 09 12:54:10 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:10 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ef813f7d-abb1-43b4-962c-c7962b0788c1" returned: 0 in 0.437s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ef813f7d-abb1-43b4-962c-c7962b0788c1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:10 devstack sudo[102800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ef813f7d-abb1-43b4-962c-c7962b0788c1 Aug 09 12:54:10 devstack sudo[102800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:11 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-def2e9de-1d81-48f4-a20e-732c2480a408 tempest-VolumesExtendTest-2099569029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d" returned: 0 in 0.437s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-def2e9de-1d81-48f4-a20e-732c2480a408 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d 2G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:11 devstack sudo[102800]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ef813f7d-abb1-43b4-962c-c7962b0788c1" returned: 0 in 0.293s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Lock "cinder-quobyte-ef813f7d-abb1-43b4-962c-c7962b0788c1" released by "delete_volume" :: held 0.794s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-def2e9de-1d81-48f4-a20e-732c2480a408 tempest-VolumesExtendTest-2099569029 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d 2G" returned: 0 in 0.141s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-def2e9de-1d81-48f4-a20e-732c2480a408 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.606s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Created reservations ['423a55b0-85af-4379-8963-f707953880ba', 'fa7031ef-1506-4c8a-a0fe-e92f8ba143db', 'c6255b9a-7489-4b18-a367-6399872128f2', '507b1525-3957-4d4f-a4dc-0a5e284f6ce5'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-def2e9de-1d81-48f4-a20e-732c2480a408 tempest-VolumesExtendTest-2099569029 None] Extend volume completed successfully. Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:11 devstack sudo[102810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:11 devstack sudo[102810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:11 devstack sudo[102810]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.374s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Deleted volume successfully. Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-65aec89d-6358-495f-937c-5ab148354a7b tempest-VolumesListAdminTestJSON-821363528 None] Lock "cinder-ef813f7d-abb1-43b4-962c-c7962b0788c1-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Acquiring lock "cinder-fed15d40-2529-4ed8-9524-2bcfd6bece5d-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Lock "cinder-fed15d40-2529-4ed8-9524-2bcfd6bece5d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Acquiring lock "cinder-quobyte-fed15d40-2529-4ed8-9524-2bcfd6bece5d" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Lock "cinder-quobyte-fed15d40-2529-4ed8-9524-2bcfd6bece5d" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:12 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eb4ba00-af3c-4d59-b218-f1ebed063db9]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:12 devstack sudo[102814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d Aug 09 12:54:12 devstack sudo[102814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:12 devstack sudo[102814]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d" returned: 0 in 0.442s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:12 devstack sudo[102819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d Aug 09 12:54:12 devstack sudo[102819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:13 devstack sudo[102819]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-fed15d40-2529-4ed8-9524-2bcfd6bece5d" returned: 0 in 0.438s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Lock "cinder-quobyte-fed15d40-2529-4ed8-9524-2bcfd6bece5d" released by "delete_volume" :: held 0.944s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:13 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Created reservations ['68d79e36-a067-4954-afa9-d279df9ba9f8', 'cc1ce4a1-7c96-4630-a89d-aba7491fee77', 'f79518d3-8874-4c89-aff7-d82374216cea', '8174f8ae-194c-499d-a684-babf3c013ac8'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:13 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:13 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:13 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.420s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:13 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:13 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Deleted volume successfully. Aug 09 12:54:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-054ef373-d6db-400a-b100-a5ae4316228c tempest-VolumesExtendTest-2099569029 None] Lock "cinder-fed15d40-2529-4ed8-9524-2bcfd6bece5d-delete_volume" released by "delete_volume" :: held 1.866s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Flow 'volume_create_manager' (9eadbd15-41e8-4b82-900a-58f66c944f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39c9a57-54d1-42b4-92c3-82571081d056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e39c9a57-54d1-42b4-92c3-82571081d056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-631170095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4105f0-674f-4ea5-bdd6-6a03c0c49897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4cfc9310914673924d8955c0762bf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:14Z,use_quota=True,user_id='d67bcfa792e74796abb275ac66d4e38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672edaaa-e85e-45ed-8819-5671417e30bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672edaaa-e85e-45ed-8819-5671417e30bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a7627a-d9f6-4220-a02a-bc12d4d0d224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39a7627a-d9f6-4220-a02a-bc12d4d0d224) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac4105f0-674f-4ea5-bdd6-6a03c0c49897', 'volume_name': 'volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3f4aaf-6bf7-4559-9196-4a4d0a10afc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb3f4aaf-6bf7-4559-9196-4a4d0a10afc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa4a2e7-8bdc-47f2-97e6-079c92ce72f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:14 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Volume ac4105f0-674f-4ea5-bdd6-6a03c0c49897: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897', 'volume_size': 1} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-631170095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac4105f0-674f-4ea5-bdd6-6a03c0c49897,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd4cfc9310914673924d8955c0762bf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:14Z,use_quota=True,user_id='d67bcfa792e74796abb275ac66d4e38d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Creating volume ac4105f0-674f-4ea5-bdd6-6a03c0c49897 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:54:14 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:54:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:14 devstack sudo[102860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 1073741824 Aug 09 12:54:14 devstack sudo[102860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:15 devstack sudo[102860]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 1073741824" returned: 0 in 0.556s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:15 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 Aug 09 12:54:15 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:15 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897" returned: 0 in 0.299s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:54:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fa4a2e7-8bdc-47f2-97e6-079c92ce72f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254b83f6-b056-4079-850a-da6af1a8f997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:15 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Volume volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 (ac4105f0-674f-4ea5-bdd6-6a03c0c49897): created successfully Aug 09 12:54:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (254b83f6-b056-4079-850a-da6af1a8f997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Flow 'volume_create_manager' (9eadbd15-41e8-4b82-900a-58f66c944f38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:15 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5a3837e0-d7cb-4579-b298-544c62723951 tempest-VolumesExtendTest-2099569029 None] Created volume successfully. Aug 09 12:54:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] Creating offline snapshot e0548995-3301-4323-a955-9a4c85733cb5 of volume ac4105f0-674f-4ea5-bdd6-6a03c0c49897 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:54:16 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[be0b5cad-5f58-439b-898d-ab9c58dd08b2]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:16 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 Aug 09 12:54:16 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:17 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897" returned: 0 in 0.406s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:17 devstack sudo[102876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 1G Aug 09 12:54:17 devstack sudo[102876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:17 devstack sudo[102876]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 1G" returned: 0 in 0.619s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:17 devstack sudo[102883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 Aug 09 12:54:17 devstack sudo[102883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:18 devstack sudo[102883]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5" returned: 0 in 0.342s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:18 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 is being set with open permissions: ugo+rw Aug 09 12:54:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:18 devstack sudo[102888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 Aug 09 12:54:18 devstack sudo[102888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:18 devstack sudo[102888]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5" returned: 0 in 0.328s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:18 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.info Aug 09 12:54:18 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:18 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.info" returned: 0 in 0.276s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:18 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.info is being set with open permissions: ugo+rw Aug 09 12:54:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:18 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.info Aug 09 12:54:18 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:19 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.info" returned: 0 in 0.289s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.367s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:19 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2fd27d9c-f09d-423a-8944-0ddad3632cd8 tempest-VolumesExtendTest-2099569029 None] Create snapshot completed successfully Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Flow 'volume_create_manager' (e2bd6cea-0d2b-4e44-bff9-c718b07acdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf168732-748f-4ea8-9f38-b33fb7b2c2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf168732-748f-4ea8-9f38-b33fb7b2c2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1841195348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4babf6c5-6f77-4f9e-9772-5c1960004a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd84ce7c561b4e99a5915fd2219bc820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:20Z,use_quota=True,user_id='01ff45544dbe4e729dc73fa0ebc8b691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4793e68-300f-424d-a449-ff6d30305d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4793e68-300f-424d-a449-ff6d30305d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f86ce20-2b6c-4384-9e89-a32baecca9ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f86ce20-2b6c-4384-9e89-a32baecca9ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4babf6c5-6f77-4f9e-9772-5c1960004a75', 'volume_name': 'volume-4babf6c5-6f77-4f9e-9772-5c1960004a75', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97ca3c5-c153-4e30-b0df-ca8322f6f392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97ca3c5-c153-4e30-b0df-ca8322f6f392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7655fd9-db84-4d94-9a1f-4d09f9683d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:19 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Volume 4babf6c5-6f77-4f9e-9772-5c1960004a75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4babf6c5-6f77-4f9e-9772-5c1960004a75', 'volume_size': 1} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1841195348',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4babf6c5-6f77-4f9e-9772-5c1960004a75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fd84ce7c561b4e99a5915fd2219bc820',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:20Z,use_quota=True,user_id='01ff45544dbe4e729dc73fa0ebc8b691',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Creating volume 4babf6c5-6f77-4f9e-9772-5c1960004a75 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:54:19 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:54:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:19 devstack sudo[102898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 1073741824 Aug 09 12:54:19 devstack sudo[102898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-273263a9-c4eb-4428-8990-740e048a04fa tempest-VolumesExtendTest-2099569029 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:20 devstack sudo[102898]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 1073741824" returned: 0 in 0.626s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:20 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 Aug 09 12:54:20 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:20 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75" returned: 0 in 0.247s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:54:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-273263a9-c4eb-4428-8990-740e048a04fa tempest-VolumesExtendTest-2099569029 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.562s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7655fd9-db84-4d94-9a1f-4d09f9683d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4babf6c5-6f77-4f9e-9772-5c1960004a75', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf88f8b0-a75d-4e8c-9142-1e0c6fff5c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:20 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc1b1f87-38a0-4bab-8760-d488eb8b5966]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-273263a9-c4eb-4428-8990-740e048a04fa tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:20 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Volume volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 (4babf6c5-6f77-4f9e-9772-5c1960004a75): created successfully Aug 09 12:54:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf88f8b0-a75d-4e8c-9142-1e0c6fff5c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Flow 'volume_create_manager' (e2bd6cea-0d2b-4e44-bff9-c718b07acdff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:20 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c25400ce-bd8c-4cb5-b091-f4308f85da43 tempest-SnapshotMetadataTestJSON-605470026 None] Created volume successfully. Aug 09 12:54:20 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 Aug 09 12:54:20 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:21 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-273263a9-c4eb-4428-8990-740e048a04fa tempest-VolumesExtendTest-2099569029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897" returned: 0 in 0.382s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-273263a9-c4eb-4428-8990-740e048a04fa tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 2G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-273263a9-c4eb-4428-8990-740e048a04fa tempest-VolumesExtendTest-2099569029 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 2G" returned: 0 in 0.299s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-273263a9-c4eb-4428-8990-740e048a04fa tempest-VolumesExtendTest-2099569029 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.734s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:21 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-273263a9-c4eb-4428-8990-740e048a04fa tempest-VolumesExtendTest-2099569029 None] Extend volume completed successfully. Aug 09 12:54:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] Creating offline snapshot 21cb0f0f-8a3c-4183-afe8-47cd4c6313db of volume 4babf6c5-6f77-4f9e-9772-5c1960004a75 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:54:21 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[da978989-d106-457e-bccb-6a80e6f9b48f]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:22 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 Aug 09 12:54:22 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Acquiring lock "cinder-e0548995-3301-4323-a955-9a4c85733cb5-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Lock "cinder-e0548995-3301-4323-a955-9a4c85733cb5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Acquiring lock "cinder-quobyte-ac4105f0-674f-4ea5-bdd6-6a03c0c49897" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:22 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75" returned: 0 in 0.501s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Lock "cinder-quobyte-ac4105f0-674f-4ea5-bdd6-6a03c0c49897" acquired by "delete_snapshot" :: waited 0.044s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Acquiring lock "cinder-quobyte-e0548995-3301-4323-a955-9a4c85733cb5" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:22 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db 1G Aug 09 12:54:22 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Lock "cinder-quobyte-e0548995-3301-4323-a955-9a4c85733cb5" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Deleting offline snapshot e0548995-3301-4323-a955-9a4c85733cb5 of volume ac4105f0-674f-4ea5-bdd6-6a03c0c49897 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] snapshot_file for this snap is: volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e0042df-cf40-48dd-baae-1842213dcf44]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:22 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 Aug 09 12:54:22 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:22 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5" returned: 0 in 0.391s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:54:22 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db 1G" returned: 0 in 0.496s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e67d2397-1350-400a-8ad0-5bff4b842614]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:22 devstack sudo[102934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db Aug 09 12:54:22 devstack sudo[102934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:23 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 Aug 09 12:54:23 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:23 devstack sudo[102934]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db" returned: 0 in 0.353s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:23 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db is being set with open permissions: ugo+rw Aug 09 12:54:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:23 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db Aug 09 12:54:23 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:23 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897" returned: 0 in 0.400s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:23 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 Aug 09 12:54:23 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:23 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db" returned: 0 in 0.271s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:23 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.info Aug 09 12:54:23 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:23 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5" returned: 0 in 0.380s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:23 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5 Aug 09 12:54:23 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:23 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.info" returned: 0 in 0.268s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:23 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.info is being set with open permissions: ugo+rw Aug 09 12:54:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:23 devstack sudo[102958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.info Aug 09 12:54:23 devstack sudo[102958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:24 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897.e0548995-3301-4323-a955-9a4c85733cb5" returned: 0 in 0.295s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Lock "cinder-quobyte-e0548995-3301-4323-a955-9a4c85733cb5" released by "_delete_snapshot" :: held 1.587s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Lock "cinder-quobyte-ac4105f0-674f-4ea5-bdd6-6a03c0c49897" released by "delete_snapshot" :: held 1.618s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:24 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Created reservations ['628a90c4-3fed-4dc7-a7a5-2c31c5207fab', 'ca454973-b596-4c0d-b64d-3bd78d77fb92', '21815375-f9f6-45ee-ae2b-b48864ad6145', '38324d4a-0f25-4ade-9fe9-04daaf7ad1b7'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:24 devstack sudo[102958]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.info" returned: 0 in 0.304s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.309s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:24 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a60880a5-b4fb-4d65-9820-bc67d8720819 tempest-SnapshotMetadataTestJSON-605470026 None] Create snapshot completed successfully Aug 09 12:54:24 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Delete snapshot completed successfully. Aug 09 12:54:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5fc34ca-103a-480e-a23c-318f69e55488 tempest-VolumesExtendTest-2099569029 None] Lock "cinder-e0548995-3301-4323-a955-9a4c85733cb5-delete_snapshot" released by "delete_snapshot" :: held 1.841s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Acquiring lock "cinder-ac4105f0-674f-4ea5-bdd6-6a03c0c49897-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Lock "cinder-ac4105f0-674f-4ea5-bdd6-6a03c0c49897-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Acquiring lock "cinder-quobyte-ac4105f0-674f-4ea5-bdd6-6a03c0c49897" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Lock "cinder-quobyte-ac4105f0-674f-4ea5-bdd6-6a03c0c49897" acquired by "delete_volume" :: waited 0.014s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:24 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[074157b7-a0ff-4c2e-b138-83c724af5caf]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:24 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 Aug 09 12:54:24 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:25 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897" returned: 0 in 0.384s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:25 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897 Aug 09 12:54:25 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:25 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ac4105f0-674f-4ea5-bdd6-6a03c0c49897" returned: 0 in 0.289s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Lock "cinder-quobyte-ac4105f0-674f-4ea5-bdd6-6a03c0c49897" released by "delete_volume" :: held 0.743s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Created reservations ['b59b927a-8ecc-4902-8f47-7d0afeaa2d82', 'c4ac1768-9e89-4f68-93ab-e4a7c62c6069', '9bcd91e1-8a25-4730-881f-7102e03b3bf0', '261a07c0-ab4e-4059-a0e4-a5e190834326'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:25 devstack sudo[102971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:25 devstack sudo[102971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Acquiring lock "cinder-21cb0f0f-8a3c-4183-afe8-47cd4c6313db-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "cinder-21cb0f0f-8a3c-4183-afe8-47cd4c6313db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Acquiring lock "cinder-quobyte-4babf6c5-6f77-4f9e-9772-5c1960004a75" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "cinder-quobyte-4babf6c5-6f77-4f9e-9772-5c1960004a75" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Acquiring lock "cinder-quobyte-21cb0f0f-8a3c-4183-afe8-47cd4c6313db" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "cinder-quobyte-21cb0f0f-8a3c-4183-afe8-47cd4c6313db" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Deleting offline snapshot 21cb0f0f-8a3c-4183-afe8-47cd4c6313db of volume 4babf6c5-6f77-4f9e-9772-5c1960004a75 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] snapshot_file for this snap is: volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bcb03e-b362-4b30-b154-2aa765a58f0c]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:25 devstack sudo[102971]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.354s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:25 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:26 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Deleted volume successfully. Aug 09 12:54:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a736e8a1-0710-4836-8f72-1d97f59b98c6 tempest-VolumesExtendTest-2099569029 None] Lock "cinder-ac4105f0-674f-4ea5-bdd6-6a03c0c49897-delete_volume" released by "delete_volume" :: held 1.346s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:26 devstack sudo[102976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db Aug 09 12:54:26 devstack sudo[102976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:26 devstack sudo[102976]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db" returned: 0 in 0.441s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4babf6c5-6f77-4f9e-9772-5c1960004a75(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:54:26 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5227855-a9db-45d7-a33a-7a220c88b02a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:26 devstack sudo[102981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 Aug 09 12:54:26 devstack sudo[102981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:26 devstack sudo[102981]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75" returned: 0 in 0.435s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:26 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db Aug 09 12:54:26 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:27 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db" returned: 0 in 0.487s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:27 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db Aug 09 12:54:27 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:27 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75.21cb0f0f-8a3c-4183-afe8-47cd4c6313db" returned: 0 in 0.356s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "cinder-quobyte-21cb0f0f-8a3c-4183-afe8-47cd4c6313db" released by "_delete_snapshot" :: held 1.870s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "cinder-quobyte-4babf6c5-6f77-4f9e-9772-5c1960004a75" released by "delete_snapshot" :: held 1.916s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:27 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Created reservations ['4086e1e6-fe6f-441a-a243-a202103364cb', '0469a992-516f-46df-8c67-d833e03f0d74', '1844b1df-7ee9-49e6-8af5-9385ecf86070', '1eb20c43-d987-4ae9-8fd3-1f08c04bce0d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:27 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Delete snapshot completed successfully. Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-391a3da4-6b76-4270-aeb6-2fb894da18e4 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "cinder-21cb0f0f-8a3c-4183-afe8-47cd4c6313db-delete_snapshot" released by "delete_snapshot" :: held 2.131s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Flow 'volume_create_manager' (baa3a1eb-1e99-4603-ae08-c40bd57b2bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979d05ba-5592-4a95-b29b-8e71cee1a4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (979d05ba-5592-4a95-b29b-8e71cee1a4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1592171351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0966b0-d53a-4d52-b050-4df54931e944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a894bc8348964f5a9723db855aa4062c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:28Z,use_quota=True,user_id='de20216657f841f7b3df1bd5dba6b808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab4b1af6-197c-4446-987a-5be4b9ef9de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab4b1af6-197c-4446-987a-5be4b9ef9de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3275df-afc2-4376-b08a-22c6f4ccbf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b3275df-afc2-4376-b08a-22c6f4ccbf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba0966b0-d53a-4d52-b050-4df54931e944', 'volume_name': 'volume-ba0966b0-d53a-4d52-b050-4df54931e944', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3e3338-6b67-4e95-a7aa-1cdbaeeaa26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad3e3338-6b67-4e95-a7aa-1cdbaeeaa26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f3dce1-8528-4b43-9161-6635fd7ddad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:28 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Volume ba0966b0-d53a-4d52-b050-4df54931e944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba0966b0-d53a-4d52-b050-4df54931e944', 'volume_size': 1} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1592171351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba0966b0-d53a-4d52-b050-4df54931e944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a894bc8348964f5a9723db855aa4062c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:28Z,use_quota=True,user_id='de20216657f841f7b3df1bd5dba6b808',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Creating volume ba0966b0-d53a-4d52-b050-4df54931e944 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:54:28 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba0966b0-d53a-4d52-b050-4df54931e944 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Acquiring lock "cinder-4babf6c5-6f77-4f9e-9772-5c1960004a75-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:28 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba0966b0-d53a-4d52-b050-4df54931e944 1073741824 Aug 09 12:54:28 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "cinder-4babf6c5-6f77-4f9e-9772-5c1960004a75-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Acquiring lock "cinder-quobyte-4babf6c5-6f77-4f9e-9772-5c1960004a75" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "cinder-quobyte-4babf6c5-6f77-4f9e-9772-5c1960004a75" acquired by "delete_volume" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee284b2-0e2e-4824-9310-e0d807a976bc]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:28 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 Aug 09 12:54:28 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:28 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba0966b0-d53a-4d52-b050-4df54931e944 1073741824" returned: 0 in 0.574s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba0966b0-d53a-4d52-b050-4df54931e944 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:28 devstack sudo[103006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba0966b0-d53a-4d52-b050-4df54931e944 Aug 09 12:54:28 devstack sudo[103006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:28 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75" returned: 0 in 0.479s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:28 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75 Aug 09 12:54:28 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:29 devstack sudo[103006]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba0966b0-d53a-4d52-b050-4df54931e944" returned: 0 in 0.308s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.938s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48f3dce1-8528-4b43-9161-6635fd7ddad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba0966b0-d53a-4d52-b050-4df54931e944', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7622690-9516-479c-bf6f-593d8f148b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:29 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Volume volume-ba0966b0-d53a-4d52-b050-4df54931e944 (ba0966b0-d53a-4d52-b050-4df54931e944): created successfully Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7622690-9516-479c-bf6f-593d8f148b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Flow 'volume_create_manager' (baa3a1eb-1e99-4603-ae08-c40bd57b2bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:29 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4babf6c5-6f77-4f9e-9772-5c1960004a75" returned: 0 in 0.328s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:29 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c7295d26-235a-4294-912a-c80ba8386760 tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Created volume successfully. Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "cinder-quobyte-4babf6c5-6f77-4f9e-9772-5c1960004a75" released by "delete_volume" :: held 0.894s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Created reservations ['772019cb-faac-49ae-b2da-04014279bcd0', '55c5f0b0-b1ec-447c-8082-de6284b991bb', '5ac7edc3-ad9c-46bc-938a-2e14dc754576', 'fdab0091-e9ff-418d-bbb8-26ff272690e2'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:29 devstack sudo[103012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:29 devstack sudo[103012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:29 devstack sudo[103012]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.285s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:29 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Deleted volume successfully. Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-50ca3fb5-8e6b-40a2-93ec-49d4d3027239 tempest-SnapshotMetadataTestJSON-605470026 None] Lock "cinder-4babf6c5-6f77-4f9e-9772-5c1960004a75-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Flow 'volume_create_manager' (cf0c8c0e-dba1-4acc-9915-c36ee192dc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166284d9-4439-4e36-83ac-74b3e46310b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (166284d9-4439-4e36-83ac-74b3e46310b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1138640288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6fbad8-dd3e-40bf-9347-d00148200d18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf226cd733b94acdb064f9511f5d8990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:30Z,use_quota=True,user_id='c2313db34cd54d32a83a77dc7deda704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37a27e2-72d9-4f1f-ad2b-f13ec173f339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a37a27e2-72d9-4f1f-ad2b-f13ec173f339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bf418f-8009-49d0-9d98-f947a1cde0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00bf418f-8009-49d0-9d98-f947a1cde0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f6fbad8-dd3e-40bf-9347-d00148200d18', 'volume_name': 'volume-7f6fbad8-dd3e-40bf-9347-d00148200d18', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d797c1-38fc-47ce-b7d7-07533539ab4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54d797c1-38fc-47ce-b7d7-07533539ab4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b54ff4d-9563-45ff-a109-b4b59a8fdbf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:29 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Volume 7f6fbad8-dd3e-40bf-9347-d00148200d18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f6fbad8-dd3e-40bf-9347-d00148200d18', 'volume_size': 1} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1138640288',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f6fbad8-dd3e-40bf-9347-d00148200d18,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf226cd733b94acdb064f9511f5d8990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:30Z,use_quota=True,user_id='c2313db34cd54d32a83a77dc7deda704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Creating volume 7f6fbad8-dd3e-40bf-9347-d00148200d18 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:54:29 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:54:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7f6fbad8-dd3e-40bf-9347-d00148200d18 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:29 devstack sudo[103015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7f6fbad8-dd3e-40bf-9347-d00148200d18 1073741824 Aug 09 12:54:29 devstack sudo[103015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:30 devstack sudo[103015]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7f6fbad8-dd3e-40bf-9347-d00148200d18 1073741824" returned: 0 in 0.471s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7f6fbad8-dd3e-40bf-9347-d00148200d18 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:30 devstack sudo[103026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7f6fbad8-dd3e-40bf-9347-d00148200d18 Aug 09 12:54:30 devstack sudo[103026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:30 devstack sudo[103026]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7f6fbad8-dd3e-40bf-9347-d00148200d18" returned: 0 in 0.305s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:54:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b54ff4d-9563-45ff-a109-b4b59a8fdbf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f6fbad8-dd3e-40bf-9347-d00148200d18', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8faace-209f-4bfd-9999-1ac3102270a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:30 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Volume volume-7f6fbad8-dd3e-40bf-9347-d00148200d18 (7f6fbad8-dd3e-40bf-9347-d00148200d18): created successfully Aug 09 12:54:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce8faace-209f-4bfd-9999-1ac3102270a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Flow 'volume_create_manager' (cf0c8c0e-dba1-4acc-9915-c36ee192dc1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:30 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-3436cc7b-3452-4be7-bedf-3bc61b9c7287 tempest-VolumesListTestJSON-163532126 None] Created volume successfully. Aug 09 12:54:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-9a9035d1-9c5f-4b8d-b305-142325788f6d req-d2959a20-b358-47ad-b5c1-7aa99102d65c tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-9a9035d1-9c5f-4b8d-b305-142325788f6d req-d2959a20-b358-47ad-b5c1-7aa99102d65c tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-9a9035d1-9c5f-4b8d-b305-142325788f6d req-d2959a20-b358-47ad-b5c1-7aa99102d65c tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.101s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-9a9035d1-9c5f-4b8d-b305-142325788f6d req-d2959a20-b358-47ad-b5c1-7aa99102d65c tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-ba0966b0-d53a-4d52-b050-4df54931e944', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '88feca67-4692-4904-9016-30efd2589276', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:54:31 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-9a9035d1-9c5f-4b8d-b305-142325788f6d req-d2959a20-b358-47ad-b5c1-7aa99102d65c tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] attachment_update completed successfully. Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Flow 'volume_create_manager' (94f61285-65fa-4de7-be2e-27747bd33f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0645a0dc-667c-4078-832c-a016d5a6b37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0645a0dc-667c-4078-832c-a016d5a6b37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1119347705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94dcb2d-7bef-4992-b955-21e777a19b5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf226cd733b94acdb064f9511f5d8990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:33Z,use_quota=True,user_id='c2313db34cd54d32a83a77dc7deda704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14bcffc-f2fe-427e-8848-f6b15ad8f131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14bcffc-f2fe-427e-8848-f6b15ad8f131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30cfbdf2-1c55-42fb-b9e7-f23316221c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30cfbdf2-1c55-42fb-b9e7-f23316221c79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94dcb2d-7bef-4992-b955-21e777a19b5c', 'volume_name': 'volume-a94dcb2d-7bef-4992-b955-21e777a19b5c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad29296c-3fef-44b6-b296-58544c91227e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad29296c-3fef-44b6-b296-58544c91227e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d993257b-af27-4b98-bc92-098317010473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:32 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Volume a94dcb2d-7bef-4992-b955-21e777a19b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94dcb2d-7bef-4992-b955-21e777a19b5c', 'volume_size': 1} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1119347705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a94dcb2d-7bef-4992-b955-21e777a19b5c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf226cd733b94acdb064f9511f5d8990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:33Z,use_quota=True,user_id='c2313db34cd54d32a83a77dc7deda704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Creating volume a94dcb2d-7bef-4992-b955-21e777a19b5c {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:54:32 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:54:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a94dcb2d-7bef-4992-b955-21e777a19b5c 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:33 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a94dcb2d-7bef-4992-b955-21e777a19b5c 1073741824 Aug 09 12:54:33 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:33 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a94dcb2d-7bef-4992-b955-21e777a19b5c 1073741824" returned: 0 in 0.662s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a94dcb2d-7bef-4992-b955-21e777a19b5c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:33 devstack sudo[103427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a94dcb2d-7bef-4992-b955-21e777a19b5c Aug 09 12:54:33 devstack sudo[103427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:34 devstack sudo[103427]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a94dcb2d-7bef-4992-b955-21e777a19b5c" returned: 0 in 0.316s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d993257b-af27-4b98-bc92-098317010473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94dcb2d-7bef-4992-b955-21e777a19b5c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960e03b0-5588-40a8-8170-56bd5c3b69da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:34 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Volume volume-a94dcb2d-7bef-4992-b955-21e777a19b5c (a94dcb2d-7bef-4992-b955-21e777a19b5c): created successfully Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (960e03b0-5588-40a8-8170-56bd5c3b69da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Flow 'volume_create_manager' (94f61285-65fa-4de7-be2e-27747bd33f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:34 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-02db9348-c684-4710-ad83-42e45c803f07 tempest-VolumesListTestJSON-163532126 None] Created volume successfully. Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Flow 'volume_create_manager' (7e95e601-b3ac-4e47-b569-0c5fefe5cdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b7fac7-21bb-42bf-843f-9aa7d962754a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23b7fac7-21bb-42bf-843f-9aa7d962754a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-819669514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3d994a-b1d5-454f-a226-384431e9a14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245cd01c3dc340a2b17e2601d2f06ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:34Z,use_quota=True,user_id='7491f1f378884602856307cace1a47f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56c6f77-c51d-4409-a375-7dfb60b975ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d56c6f77-c51d-4409-a375-7dfb60b975ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b99227-3d49-474b-a67b-c75748c4757d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8b99227-3d49-474b-a67b-c75748c4757d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a3d994a-b1d5-454f-a226-384431e9a14f', 'volume_name': 'volume-9a3d994a-b1d5-454f-a226-384431e9a14f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6159f6f8-e52f-424b-bff2-07268b67995e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6159f6f8-e52f-424b-bff2-07268b67995e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750fd1d0-7107-4816-b0d1-cd3cf353c51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:34 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Volume 9a3d994a-b1d5-454f-a226-384431e9a14f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a3d994a-b1d5-454f-a226-384431e9a14f', 'volume_size': 1} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-819669514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a3d994a-b1d5-454f-a226-384431e9a14f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245cd01c3dc340a2b17e2601d2f06ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:34Z,use_quota=True,user_id='7491f1f378884602856307cace1a47f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Creating volume 9a3d994a-b1d5-454f-a226-384431e9a14f {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:54:34 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:54:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:34 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f 1073741824 Aug 09 12:54:34 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:35 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f 1073741824" returned: 0 in 0.774s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:35 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f Aug 09 12:54:35 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Flow 'volume_create_manager' (68f7832c-4b1c-40eb-9d56-d7dd26407e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302f06b4-7d40-4f07-83f8-6d82348b3ca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (302f06b4-7d40-4f07-83f8-6d82348b3ca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1892554140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3c14d8-0e62-4e28-a8ae-a3b236c11a48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf226cd733b94acdb064f9511f5d8990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:36Z,use_quota=True,user_id='c2313db34cd54d32a83a77dc7deda704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef49d2e0-a1bc-4a5a-a5a5-e17b4c3a5fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef49d2e0-a1bc-4a5a-a5a5-e17b4c3a5fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4217a36-ebfb-46e1-b616-333e8cf263f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4217a36-ebfb-46e1-b616-333e8cf263f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b3c14d8-0e62-4e28-a8ae-a3b236c11a48', 'volume_name': 'volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968e4c0c-34f7-4221-abc3-2ec55071123b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (968e4c0c-34f7-4221-abc3-2ec55071123b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04dd552-232c-4f1c-adcc-d2387240b6c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:35 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Volume 4b3c14d8-0e62-4e28-a8ae-a3b236c11a48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48', 'volume_size': 1} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:35 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f" returned: 0 in 0.393s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] <== create_volume: return (1299ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.074s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1892554140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b3c14d8-0e62-4e28-a8ae-a3b236c11a48,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='bf226cd733b94acdb064f9511f5d8990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:36Z,use_quota=True,user_id='c2313db34cd54d32a83a77dc7deda704',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Creating volume 4b3c14d8-0e62-4e28-a8ae-a3b236c11a48 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:54:35 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:35 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=144,cinder:UPDATE=166,cinder:INSERT=46,cinder:DELETE=11 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:54:35 devstack sudo[103469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48 1073741824 Aug 09 12:54:35 devstack sudo[103469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (750fd1d0-7107-4816-b0d1-cd3cf353c51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a3d994a-b1d5-454f-a226-384431e9a14f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353caa24-51df-45e8-a7fa-b469abbccc26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:36 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-6d5be461-94f6-4c68-b433-d1f6ef196011 req-bde2dcc6-24b6-45eb-bc56-ded4a11e535a tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Terminate volume connection completed successfully. Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-6d5be461-94f6-4c68-b433-d1f6ef196011 req-bde2dcc6-24b6-45eb-bc56-ded4a11e535a tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Deleting attachment 88feca67-4692-4904-9016-30efd2589276. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:54:36 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Volume volume-9a3d994a-b1d5-454f-a226-384431e9a14f (9a3d994a-b1d5-454f-a226-384431e9a14f): created successfully Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (353caa24-51df-45e8-a7fa-b469abbccc26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Flow 'volume_create_manager' (7e95e601-b3ac-4e47-b569-0c5fefe5cdf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:36 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a78d3f83-2187-4485-9fce-0ca0568f7bee tempest-VolumesCloneTest-152597188 None] Created volume successfully. Aug 09 12:54:36 devstack sudo[103469]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48 1073741824" returned: 0 in 0.605s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Acquiring lock "cinder-ba0966b0-d53a-4d52-b050-4df54931e944-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Lock "cinder-ba0966b0-d53a-4d52-b050-4df54931e944-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:36 devstack sudo[103475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48 Aug 09 12:54:36 devstack sudo[103475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Acquiring lock "cinder-quobyte-ba0966b0-d53a-4d52-b050-4df54931e944" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Lock "cinder-quobyte-ba0966b0-d53a-4d52-b050-4df54931e944" acquired by "delete_volume" :: waited 0.031s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ca0f33-b27b-40c1-b7e6-29035706b696]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba0966b0-d53a-4d52-b050-4df54931e944 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:36 devstack sudo[103475]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48" returned: 0 in 0.345s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:54:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:36 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba0966b0-d53a-4d52-b050-4df54931e944 Aug 09 12:54:36 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e04dd552-232c-4f1c-adcc-d2387240b6c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b41587-f21f-4cfa-836a-60cd2d740ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:37 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Volume volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48 (4b3c14d8-0e62-4e28-a8ae-a3b236c11a48): created successfully Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71b41587-f21f-4cfa-836a-60cd2d740ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Flow 'volume_create_manager' (68f7832c-4b1c-40eb-9d56-d7dd26407e86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:37 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d2018de7-7cac-4d2d-9ffe-7ed2b07ffdec tempest-VolumesListTestJSON-163532126 None] Created volume successfully. Aug 09 12:54:37 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba0966b0-d53a-4d52-b050-4df54931e944" returned: 0 in 0.716s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba0966b0-d53a-4d52-b050-4df54931e944 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:37 devstack sudo[103483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba0966b0-d53a-4d52-b050-4df54931e944 Aug 09 12:54:37 devstack sudo[103483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Flow 'volume_create_manager' (b9c03eaf-cc1f-426b-9199-ee4a3fd22786) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3470e5c3-06ea-4d9f-bb21-40e96b25e6a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3470e5c3-06ea-4d9f-bb21-40e96b25e6a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:54:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-699049065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571bacdf-b7f9-432f-9f39-cd2593ab78c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='245cd01c3dc340a2b17e2601d2f06ee5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:54:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=9a3d994a-b1d5-454f-a226-384431e9a14f,status='creating',terminated_at=None,updated_at=2026-08-09T10:54:38Z,use_quota=True,user_id='7491f1f378884602856307cace1a47f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3831751e-72df-46e4-bbe7-2ee8ec5bbbe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3831751e-72df-46e4-bbe7-2ee8ec5bbbe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed66f01-f3c9-44e3-8d56-6bdb172a4b37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed66f01-f3c9-44e3-8d56-6bdb172a4b37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '571bacdf-b7f9-432f-9f39-cd2593ab78c3', 'volume_name': 'volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3', 'volume_size': 2, 'source_volid': '9a3d994a-b1d5-454f-a226-384431e9a14f', 'source_volstatus': 'available'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa0d11a-042c-418e-9dc3-cfe61a915c5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fa0d11a-042c-418e-9dc3-cfe61a915c5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:37 devstack sudo[103483]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8fe9be-5af5-4a93-a232-2cf409de0b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:37 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Volume 571bacdf-b7f9-432f-9f39-cd2593ab78c3: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3', 'volume_size': 2, 'source_volid': '9a3d994a-b1d5-454f-a226-384431e9a14f', 'source_volstatus': 'available'} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba0966b0-d53a-4d52-b050-4df54931e944" returned: 0 in 0.438s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:37 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Cloning volume 9a3d994a-b1d5-454f-a226-384431e9a14f to volume 571bacdf-b7f9-432f-9f39-cd2593ab78c3 Aug 09 12:54:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Lock "cinder-quobyte-ba0966b0-d53a-4d52-b050-4df54931e944" released by "delete_volume" :: held 1.233s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Creating offline snapshot 18a7edb4-76b4-475c-86d2-8d022b777e82 of volume 9a3d994a-b1d5-454f-a226-384431e9a14f {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9238415e-c98b-4830-a5f6-352437755a47]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Created reservations ['26b33893-bc63-44e8-9835-813d4f911f70', '2cd74da5-f85c-4d12-831f-946fa7c515b3', 'f9304e6b-29cf-49bb-92ee-362e576287cc', 'e16afee0-0f51-4134-aa91-091c98a30315'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:38 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f Aug 09 12:54:38 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:38 devstack sudo[103493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:38 devstack sudo[103493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:38 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f" returned: 0 in 0.539s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:38 devstack sudo[103502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 1G Aug 09 12:54:38 devstack sudo[103502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:38 devstack sudo[103493]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.393s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:38 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Deleted volume successfully. Aug 09 12:54:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-93ed9a16-c5d5-4ac2-a479-7a9538fac63d tempest-TestServerVolumeAttachScenarioOldVersion-933512418 None] Lock "cinder-ba0966b0-d53a-4d52-b050-4df54931e944-delete_volume" released by "delete_volume" :: held 2.134s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:39 devstack sudo[103502]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 1G" returned: 0 in 0.689s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3d994a-b1d5-454f-a226-384431e9a14f -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:39 devstack sudo[103509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3d994a-b1d5-454f-a226-384431e9a14f -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 Aug 09 12:54:39 devstack sudo[103509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:39 devstack sudo[103509]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a3d994a-b1d5-454f-a226-384431e9a14f -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82" returned: 0 in 0.383s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:39 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 is being set with open permissions: ugo+rw Aug 09 12:54:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:39 devstack sudo[103527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 Aug 09 12:54:39 devstack sudo[103527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:40 devstack sudo[103527]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82" returned: 0 in 0.506s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:40 devstack sudo[103542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.info Aug 09 12:54:40 devstack sudo[103542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:40 devstack sudo[103542]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.info" returned: 0 in 0.341s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:40 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.info is being set with open permissions: ugo+rw Aug 09 12:54:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:40 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.info Aug 09 12:54:40 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:41 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.info" returned: 0 in 0.445s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Acquiring lock "cinder-quobyte-571bacdf-b7f9-432f-9f39-cd2593ab78c3" by "_copy_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Lock "cinder-quobyte-571bacdf-b7f9-432f-9f39-cd2593ab78c3" acquired by "_copy_volume_from_snapshot" :: waited 0.046s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] snapshot: 18a7edb4-76b4-475c-86d2-8d022b777e82, volume: 571bacdf-b7f9-432f-9f39-cd2593ab78c3, {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba73b791-22fd-49bd-a87f-7af55f9f4d2a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Acquiring lock "cinder-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Lock "cinder-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Acquiring lock "cinder-quobyte-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Lock "cinder-quobyte-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48" acquired by "delete_volume" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:41 devstack sudo[103585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 Aug 09 12:54:41 devstack sudo[103585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f96991c-d152-4526-94b9-ff63185924d0]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:41 devstack sudo[103587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48 Aug 09 12:54:41 devstack sudo[103587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:41 devstack sudo[103585]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82" returned: 0 in 0.631s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a3d994a-b1d5-454f-a226-384431e9a14f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[425204e1-14b6-4e30-b605-1911bbabc903]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:42 devstack sudo[103594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f Aug 09 12:54:42 devstack sudo[103594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:42 devstack sudo[103587]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48" returned: 0 in 0.530s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:42 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48 Aug 09 12:54:42 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:42 devstack sudo[103594]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f" returned: 0 in 0.438s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Creating direct copy from snapshot {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG cinder.utils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Path /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3 not found in is_blk_device check {{(pid=89309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:42 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48" returned: 0 in 0.322s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:42 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3 Aug 09 12:54:42 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Lock "cinder-quobyte-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48" released by "delete_volume" :: held 0.934s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Created reservations ['b1266937-a9ff-4c95-a4c0-ff7ea6946466', 'f0f92c05-68c1-4efb-83cc-a56cd76e8b15', 'c66f6bab-1d72-4a34-adee-fcad8df0bffa', '8aed2edb-cd37-46b2-94d3-df342acee2db'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:42 devstack sudo[103607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:42 devstack sudo[103607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Acquiring lock "cinder-a94dcb2d-7bef-4992-b955-21e777a19b5c-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Lock "cinder-a94dcb2d-7bef-4992-b955-21e777a19b5c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Acquiring lock "cinder-quobyte-a94dcb2d-7bef-4992-b955-21e777a19b5c" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Lock "cinder-quobyte-a94dcb2d-7bef-4992-b955-21e777a19b5c" acquired by "delete_volume" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d102b5f-2cba-475e-b817-00afcecf2f22]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a94dcb2d-7bef-4992-b955-21e777a19b5c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:43 devstack sudo[103607]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.373s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:43 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:43 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Deleted volume successfully. Aug 09 12:54:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2c906a4c-a974-4d38-ad2b-ddb0b55d881f tempest-VolumesListTestJSON-163532126 None] Lock "cinder-4b3c14d8-0e62-4e28-a8ae-a3b236c11a48-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:43 devstack sudo[103613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a94dcb2d-7bef-4992-b955-21e777a19b5c Aug 09 12:54:43 devstack sudo[103613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:44 devstack sudo[103613]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a94dcb2d-7bef-4992-b955-21e777a19b5c" returned: 0 in 1.062s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a94dcb2d-7bef-4992-b955-21e777a19b5c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:44 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a94dcb2d-7bef-4992-b955-21e777a19b5c Aug 09 12:54:44 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:44 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a94dcb2d-7bef-4992-b955-21e777a19b5c" returned: 0 in 0.685s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Lock "cinder-quobyte-a94dcb2d-7bef-4992-b955-21e777a19b5c" released by "delete_volume" :: held 1.817s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:44 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=142,cinder:UPDATE=175,cinder:INSERT=42,cinder:DELETE=16 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:54:45 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Created reservations ['e59cee28-4e04-4c4d-b9ef-43b0a8acab38', '699b54e0-b606-442c-a74b-1b46a2c0f35c', '1469a4e6-15d1-4683-b602-bfbc49800bad', 'f25f4038-a100-494f-b628-aeeaf817ad14'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:45 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:45 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:45 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Acquiring lock "cinder-7f6fbad8-dd3e-40bf-9347-d00148200d18-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:45 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Lock "cinder-7f6fbad8-dd3e-40bf-9347-d00148200d18-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:45 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Acquiring lock "cinder-quobyte-7f6fbad8-dd3e-40bf-9347-d00148200d18" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:45 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Lock "cinder-quobyte-7f6fbad8-dd3e-40bf-9347-d00148200d18" acquired by "delete_volume" :: waited 0.049s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:45 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5807683f-a0bb-49ff-9547-34790ade1f70]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7f6fbad8-dd3e-40bf-9347-d00148200d18 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:46 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.997s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:46 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:46 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Deleted volume successfully. Aug 09 12:54:46 devstack sudo[103630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7f6fbad8-dd3e-40bf-9347-d00148200d18 Aug 09 12:54:46 devstack sudo[103630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb28eba-a0ec-4951-8bfe-c3470c210ca0 tempest-VolumesListTestJSON-163532126 None] Lock "cinder-a94dcb2d-7bef-4992-b955-21e777a19b5c-delete_volume" released by "delete_volume" :: held 3.541s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:47 devstack sudo[103630]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7f6fbad8-dd3e-40bf-9347-d00148200d18" returned: 0 in 1.121s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7f6fbad8-dd3e-40bf-9347-d00148200d18 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:47 devstack sudo[103637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7f6fbad8-dd3e-40bf-9347-d00148200d18 Aug 09 12:54:47 devstack sudo[103637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:47 devstack sudo[103637]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7f6fbad8-dd3e-40bf-9347-d00148200d18" returned: 0 in 0.890s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Lock "cinder-quobyte-7f6fbad8-dd3e-40bf-9347-d00148200d18" released by "delete_volume" :: held 2.158s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:48 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Created reservations ['4f6982b9-b153-4d9f-8f26-a12220602ccd', '9d449ef2-fc24-4191-b863-bb9279d6ebda', '03530b44-1a83-4e31-b8b1-537bc0365e1b', 'ec9dc30a-5b4a-49ec-8db1-d9784c451e89'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:48 devstack sudo[103640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:48 devstack sudo[103640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:48 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3" returned: 0 in 6.433s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:48 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f, size 1024.00 MB, duration 6.43 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:54:48 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Converted 1024.00 MB image at 159.14 MB/s Aug 09 12:54:48 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3 is being set with open permissions: ugo+rw Aug 09 12:54:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:48 devstack sudo[103642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3 Aug 09 12:54:48 devstack sudo[103642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:48 devstack sudo[103640]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.597s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:48 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Deleted volume successfully. Aug 09 12:54:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b2205d2d-b840-4511-8ae8-951877d0c040 tempest-VolumesListTestJSON-163532126 None] Lock "cinder-7f6fbad8-dd3e-40bf-9347-d00148200d18-delete_volume" released by "delete_volume" :: held 3.433s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:49 devstack sudo[103642]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3" returned: 0 in 0.355s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Lock "cinder-quobyte-571bacdf-b7f9-432f-9f39-cd2593ab78c3" released by "_copy_volume_from_snapshot" :: held 7.991s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Acquiring lock "cinder-quobyte-18a7edb4-76b4-475c-86d2-8d022b777e82" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Lock "cinder-quobyte-18a7edb4-76b4-475c-86d2-8d022b777e82" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Deleting offline snapshot 18a7edb4-76b4-475c-86d2-8d022b777e82 of volume 9a3d994a-b1d5-454f-a226-384431e9a14f {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:54:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] snapshot_file for this snap is: volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:54:49 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[97b3d5ce-b7f0-437d-a4be-f93bfcba97ce]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:49 devstack sudo[103647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 Aug 09 12:54:49 devstack sudo[103647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:49 devstack sudo[103647]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82" returned: 0 in 0.472s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a3d994a-b1d5-454f-a226-384431e9a14f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:54:49 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab39f379-16a2-438f-92eb-9ed64a931f34]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:49 devstack sudo[103654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f Aug 09 12:54:49 devstack sudo[103654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:50 devstack sudo[103654]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f" returned: 0 in 0.669s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:50 devstack sudo[103661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 Aug 09 12:54:50 devstack sudo[103661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:50 devstack sudo[103661]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82" returned: 0 in 0.509s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:51 devstack sudo[103666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82 Aug 09 12:54:51 devstack sudo[103666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:51 devstack sudo[103666]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f.18a7edb4-76b4-475c-86d2-8d022b777e82" returned: 0 in 0.349s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Lock "cinder-quobyte-18a7edb4-76b4-475c-86d2-8d022b777e82" released by "_delete_snapshot" :: held 2.160s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.452s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a8fe9be-5af5-4a93-a232-2cf409de0b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3', 'volume_size': 2, 'source_volid': '9a3d994a-b1d5-454f-a226-384431e9a14f', 'source_volstatus': 'available'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8063b2f5-2305-4d89-8712-678948c12038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:54:51 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Volume volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3 (571bacdf-b7f9-432f-9f39-cd2593ab78c3): created successfully Aug 09 12:54:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8063b2f5-2305-4d89-8712-678948c12038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:54:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Flow 'volume_create_manager' (b9c03eaf-cc1f-426b-9199-ee4a3fd22786) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:54:51 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-03841b92-7b68-46df-8f22-d7a4d1e894ec tempest-VolumesCloneTest-152597188 None] Created volume successfully. Aug 09 12:54:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Acquiring lock "cinder-571bacdf-b7f9-432f-9f39-cd2593ab78c3-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Lock "cinder-571bacdf-b7f9-432f-9f39-cd2593ab78c3-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Acquiring lock "cinder-quobyte-571bacdf-b7f9-432f-9f39-cd2593ab78c3" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Lock "cinder-quobyte-571bacdf-b7f9-432f-9f39-cd2593ab78c3" acquired by "delete_volume" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:52 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6ab07f-d026-4d8c-a332-8d83aab713f9]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:52 devstack sudo[103675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3 Aug 09 12:54:52 devstack sudo[103675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:53 devstack sudo[103675]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3" returned: 0 in 0.431s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:53 devstack sudo[103680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3 Aug 09 12:54:53 devstack sudo[103680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:53 devstack sudo[103680]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-571bacdf-b7f9-432f-9f39-cd2593ab78c3" returned: 0 in 0.289s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Lock "cinder-quobyte-571bacdf-b7f9-432f-9f39-cd2593ab78c3" released by "delete_volume" :: held 0.778s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Created reservations ['05660c58-b908-46d3-9152-826da4e4c8c3', '59d53064-0a23-448b-aa9e-04d24d5b47d2', 'e9f8e3ec-c589-4874-8a26-f9e08249d6e8', '6f0c8ab9-8e83-4d53-9509-514047c0e057'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:53 devstack sudo[103683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:53 devstack sudo[103683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Acquiring lock "cinder-9a3d994a-b1d5-454f-a226-384431e9a14f-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Lock "cinder-9a3d994a-b1d5-454f-a226-384431e9a14f-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:53 devstack sudo[103683]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.336s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:53 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Deleted volume successfully. Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Acquiring lock "cinder-quobyte-9a3d994a-b1d5-454f-a226-384431e9a14f" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-233b69e6-b266-4279-9dc9-0d4360950742 tempest-VolumesCloneTest-152597188 None] Lock "cinder-571bacdf-b7f9-432f-9f39-cd2593ab78c3-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Lock "cinder-quobyte-9a3d994a-b1d5-454f-a226-384431e9a14f" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:54:54 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fdc552c-336e-4fcb-90ff-bc4d35ad9d07]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:54:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:54 devstack sudo[103686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f Aug 09 12:54:54 devstack sudo[103686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:54 devstack sudo[103686]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f" returned: 0 in 0.650s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:54 devstack sudo[103692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f Aug 09 12:54:54 devstack sudo[103692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:55 devstack sudo[103692]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9a3d994a-b1d5-454f-a226-384431e9a14f" returned: 0 in 0.367s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Lock "cinder-quobyte-9a3d994a-b1d5-454f-a226-384431e9a14f" released by "delete_volume" :: held 1.108s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:55 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Created reservations ['b6ccac05-cfd7-4eba-a25a-7814413ccd58', '0b66be67-e870-48a2-83c2-ba3a5f3caf1d', '999dd700-fadf-4e0f-b6c9-2ba1bfd77e54', '29922454-e8bc-4a6f-9fbc-cb0588d94fcb'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:54:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:55 devstack sudo[103695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:55 devstack sudo[103695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:55 devstack sudo[103695]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.260s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:55 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:55 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Deleted volume successfully. Aug 09 12:54:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b4f3d443-e62e-4f26-91ff-47cbcdc6882a tempest-VolumesCloneTest-152597188 None] Lock "cinder-9a3d994a-b1d5-454f-a226-384431e9a14f-delete_volume" released by "delete_volume" :: held 1.768s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:54:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:54:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:54:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:54:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:54:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:54:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:54:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:54:57 devstack sudo[103700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:54:57 devstack sudo[103700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:54:58 devstack sudo[103700]: pam_unix(sudo:session): session closed for user root Aug 09 12:54:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.289s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:54:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:54:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:54:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:54:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (d21dca38-9b03-44e8-85c6-5a48a89feba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f1ead4-fcf9-46c6-85c5-1c91c5e9b88b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44f1ead4-fcf9-46c6-85c5-1c91c5e9b88b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1329981404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0934be2-ec4d-493e-acd2-917b7f92c454,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e76d6387874e4533993c667097aeead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:00Z,use_quota=True,user_id='be60389d60a14878b6234a268c3843aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187a2e80-1e2a-40f3-945c-77c7c0857f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (187a2e80-1e2a-40f3-945c-77c7c0857f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2c21c4-1720-4fb0-b492-4a137b2c20a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2c21c4-1720-4fb0-b492-4a137b2c20a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0934be2-ec4d-493e-acd2-917b7f92c454', 'volume_name': 'volume-f0934be2-ec4d-493e-acd2-917b7f92c454', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bea1fb-07f4-4bfa-bf83-caed821de14d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5bea1fb-07f4-4bfa-bf83-caed821de14d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5cc631-a381-43a2-9866-0595bec9b4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:00 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Volume f0934be2-ec4d-493e-acd2-917b7f92c454: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0934be2-ec4d-493e-acd2-917b7f92c454', 'volume_size': 1} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1329981404',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0934be2-ec4d-493e-acd2-917b7f92c454,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e76d6387874e4533993c667097aeead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:00Z,use_quota=True,user_id='be60389d60a14878b6234a268c3843aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Creating volume f0934be2-ec4d-493e-acd2-917b7f92c454 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:55:00 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0934be2-ec4d-493e-acd2-917b7f92c454 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:00 devstack sudo[103705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0934be2-ec4d-493e-acd2-917b7f92c454 1073741824 Aug 09 12:55:00 devstack sudo[103705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:00 devstack sudo[103705]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0934be2-ec4d-493e-acd2-917b7f92c454 1073741824" returned: 0 in 0.522s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0934be2-ec4d-493e-acd2-917b7f92c454 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:00 devstack sudo[103711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0934be2-ec4d-493e-acd2-917b7f92c454 Aug 09 12:55:00 devstack sudo[103711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:01 devstack sudo[103711]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0934be2-ec4d-493e-acd2-917b7f92c454" returned: 0 in 0.311s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:55:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa5cc631-a381-43a2-9866-0595bec9b4e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0934be2-ec4d-493e-acd2-917b7f92c454', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586181db-64be-4d9c-b4b0-2a260db78b2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:01 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Volume volume-f0934be2-ec4d-493e-acd2-917b7f92c454 (f0934be2-ec4d-493e-acd2-917b7f92c454): created successfully Aug 09 12:55:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (586181db-64be-4d9c-b4b0-2a260db78b2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (d21dca38-9b03-44e8-85c6-5a48a89feba6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:01 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-566d4248-c7f8-4268-99ca-4ff594dc48e4 tempest-VolumesGetTest-1608686802 None] Created volume successfully. Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (e2f8d1ae-2855-4b6a-9ce4-83ff8a8d90c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5573f83-6ca0-4d58-a54c-6c62c98270a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5573f83-6ca0-4d58-a54c-6c62c98270a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1127796671',display_name='tempest-VolumesGetTest-Volume-1966677916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6e9f56-2e31-494a-b100-254c975838dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76d6387874e4533993c667097aeead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:03Z,use_quota=True,user_id='be60389d60a14878b6234a268c3843aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c1fec3-1fa4-4061-b162-d94e74cbc9ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8c1fec3-1fa4-4061-b162-d94e74cbc9ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511795f9-1b33-476a-8bab-34281bd7460d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (511795f9-1b33-476a-8bab-34281bd7460d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bc6e9f56-2e31-494a-b100-254c975838dd', 'volume_name': 'volume-bc6e9f56-2e31-494a-b100-254c975838dd', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0db3cb6-8477-4dda-a58b-153eebd11c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0db3cb6-8477-4dda-a58b-153eebd11c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b59420e-9ef1-424c-a6a0-10c3ddab205a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:03 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Volume bc6e9f56-2e31-494a-b100-254c975838dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bc6e9f56-2e31-494a-b100-254c975838dd', 'volume_size': 1} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:03Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1127796671',display_name='tempest-VolumesGetTest-Volume-1966677916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bc6e9f56-2e31-494a-b100-254c975838dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76d6387874e4533993c667097aeead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:03Z,use_quota=True,user_id='be60389d60a14878b6234a268c3843aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Creating volume bc6e9f56-2e31-494a-b100-254c975838dd {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:55:03 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc6e9f56-2e31-494a-b100-254c975838dd 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:03 devstack sudo[103717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc6e9f56-2e31-494a-b100-254c975838dd 1073741824 Aug 09 12:55:03 devstack sudo[103717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:03 devstack sudo[103717]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc6e9f56-2e31-494a-b100-254c975838dd 1073741824" returned: 0 in 0.548s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc6e9f56-2e31-494a-b100-254c975838dd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:03 devstack sudo[103763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc6e9f56-2e31-494a-b100-254c975838dd Aug 09 12:55:03 devstack sudo[103763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:04 devstack sudo[103763]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc6e9f56-2e31-494a-b100-254c975838dd" returned: 0 in 0.343s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:55:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b59420e-9ef1-424c-a6a0-10c3ddab205a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bc6e9f56-2e31-494a-b100-254c975838dd', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e08c7e-49c0-43ba-aa12-1c59f543ec30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:04 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Volume volume-bc6e9f56-2e31-494a-b100-254c975838dd (bc6e9f56-2e31-494a-b100-254c975838dd): created successfully Aug 09 12:55:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6e08c7e-49c0-43ba-aa12-1c59f543ec30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (e2f8d1ae-2855-4b6a-9ce4-83ff8a8d90c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:04 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-31312e04-a1c3-4581-862e-49eeeb1904f7 tempest-VolumesGetTest-1608686802 None] Created volume successfully. Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Flow 'volume_create_manager' (6937e939-4978-46d6-ae75-945218d03ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358b1eaa-eeb1-489c-b414-e8da85932c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (358b1eaa-eeb1-489c-b414-e8da85932c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1494684573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4e7c94-cb65-44ff-b270-924e9bbc3afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308c6a5d61294bb591d013be9e9e17b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:05Z,use_quota=True,user_id='c8a57da4812a4ec7980d54ca18486e99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea818bff-6c08-4263-9883-2b9327b1b0f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ea818bff-6c08-4263-9883-2b9327b1b0f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d484e797-78aa-4b70-b6bd-eac3c8870216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d484e797-78aa-4b70-b6bd-eac3c8870216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e4e7c94-cb65-44ff-b270-924e9bbc3afa', 'volume_name': 'volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c163e008-ae3a-49fe-b5c4-ff22ff3cc6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c163e008-ae3a-49fe-b5c4-ff22ff3cc6ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde4e921-2b02-4b99-9cc9-c665c47de3a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:05 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Volume 3e4e7c94-cb65-44ff-b270-924e9bbc3afa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa', 'volume_size': 1} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1494684573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4e7c94-cb65-44ff-b270-924e9bbc3afa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308c6a5d61294bb591d013be9e9e17b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:05Z,use_quota=True,user_id='c8a57da4812a4ec7980d54ca18486e99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Creating volume 3e4e7c94-cb65-44ff-b270-924e9bbc3afa {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:55:05 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:05 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa 1073741824 Aug 09 12:55:05 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-bc6e9f56-2e31-494a-b100-254c975838dd-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Lock "cinder-bc6e9f56-2e31-494a-b100-254c975838dd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-quobyte-bc6e9f56-2e31-494a-b100-254c975838dd" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-bc6e9f56-2e31-494a-b100-254c975838dd" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[af68c380-5e88-41bd-865f-471975c83ab7]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc6e9f56-2e31-494a-b100-254c975838dd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:05 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc6e9f56-2e31-494a-b100-254c975838dd Aug 09 12:55:05 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:06 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa 1073741824" returned: 0 in 0.717s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:06 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc6e9f56-2e31-494a-b100-254c975838dd" returned: 0 in 0.516s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc6e9f56-2e31-494a-b100-254c975838dd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:06 devstack sudo[104067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc6e9f56-2e31-494a-b100-254c975838dd Aug 09 12:55:06 devstack sudo[104067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:06 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa Aug 09 12:55:06 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:06 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa" returned: 0 in 0.353s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.212s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:06 devstack sudo[104067]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-bc6e9f56-2e31-494a-b100-254c975838dd" returned: 0 in 0.404s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-bc6e9f56-2e31-494a-b100-254c975838dd" released by "delete_volume" :: held 0.993s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dde4e921-2b02-4b99-9cc9-c665c47de3a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab19b2c7-712e-43e6-8ff4-3817b268e32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:06 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Volume volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa (3e4e7c94-cb65-44ff-b270-924e9bbc3afa): created successfully Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab19b2c7-712e-43e6-8ff4-3817b268e32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Flow 'volume_create_manager' (6937e939-4978-46d6-ae75-945218d03ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:06 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-fdb1465e-2cba-433e-8dfd-d191318531fb tempest-TestStampPattern-316392764 None] Created volume successfully. Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Created reservations ['8f0298c0-9e26-4d3e-80f4-022c09ccc4b4', '257aed1d-bcc7-4a28-be5a-63f036241e56', 'eb42e2fe-3a5b-42a1-9b7d-cc0ec19bd140', '1b431662-3f31-4ac7-86e9-b1b8e1c7f017'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:06 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:55:06 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:07 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.339s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:07 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:55:07 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Deleted volume successfully. Aug 09 12:55:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f25cd461-fe4a-40fb-b5d8-82272ae3f2d4 tempest-VolumesGetTest-1608686802 None] Lock "cinder-bc6e9f56-2e31-494a-b100-254c975838dd-delete_volume" released by "delete_volume" :: held 1.720s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:55:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-f0934be2-ec4d-493e-acd2-917b7f92c454-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:55:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Lock "cinder-f0934be2-ec4d-493e-acd2-917b7f92c454-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:55:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-quobyte-f0934be2-ec4d-493e-acd2-917b7f92c454" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:55:08 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-f0934be2-ec4d-493e-acd2-917b7f92c454" acquired by "delete_volume" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:55:08 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b447116-d378-4225-9254-bf86658b831c]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0934be2-ec4d-493e-acd2-917b7f92c454 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:08 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0934be2-ec4d-493e-acd2-917b7f92c454 Aug 09 12:55:08 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:08 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0934be2-ec4d-493e-acd2-917b7f92c454" returned: 0 in 0.615s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0934be2-ec4d-493e-acd2-917b7f92c454 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:08 devstack sudo[104084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0934be2-ec4d-493e-acd2-917b7f92c454 Aug 09 12:55:08 devstack sudo[104084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:09 devstack sudo[104084]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f0934be2-ec4d-493e-acd2-917b7f92c454" returned: 0 in 0.333s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-f0934be2-ec4d-493e-acd2-917b7f92c454" released by "delete_volume" :: held 1.017s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:55:09 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Created reservations ['faa87a71-866b-4551-882d-9f8aacee9682', '7bd8f6c0-bac4-49d9-85d5-bb985e2fc20c', '201e4f77-fafa-4f0b-b116-1ebcfd44053e', 'd17d01b9-829c-46d5-98bf-8faaf8c06599'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:55:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:09 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:55:09 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:09 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.444s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:09 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:55:09 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Deleted volume successfully. Aug 09 12:55:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-77425573-5746-4cb8-a84a-feabdd52e1cb tempest-VolumesGetTest-1608686802 None] Lock "cinder-f0934be2-ec4d-493e-acd2-917b7f92c454-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (77c8f038-15fe-48a5-89fc-4e1f8f554aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4846ed5-b907-47e4-98ce-1bcdbf44ea0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4846ed5-b907-47e4-98ce-1bcdbf44ea0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1694511855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6db33bd-cc08-4373-a561-84d76b32234a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76d6387874e4533993c667097aeead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:11Z,use_quota=True,user_id='be60389d60a14878b6234a268c3843aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b936da-40eb-4f44-927c-faa4ddddac16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84b936da-40eb-4f44-927c-faa4ddddac16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f7e899-5347-444e-8da3-92421ce052c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0f7e899-5347-444e-8da3-92421ce052c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6db33bd-cc08-4373-a561-84d76b32234a', 'volume_name': 'volume-c6db33bd-cc08-4373-a561-84d76b32234a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29754744-f499-4f53-b349-64951def8df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29754744-f499-4f53-b349-64951def8df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9267bc4-ae61-427d-ae46-1684063198c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:10 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Volume c6db33bd-cc08-4373-a561-84d76b32234a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6db33bd-cc08-4373-a561-84d76b32234a', 'volume_size': 1} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1694511855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6db33bd-cc08-4373-a561-84d76b32234a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76d6387874e4533993c667097aeead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:11Z,use_quota=True,user_id='be60389d60a14878b6234a268c3843aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Creating volume c6db33bd-cc08-4373-a561-84d76b32234a {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:55:10 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:55:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:11 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a 1073741824 Aug 09 12:55:11 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:11 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a 1073741824" returned: 0 in 0.520s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:11 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a Aug 09 12:55:11 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:11 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a" returned: 0 in 0.296s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:55:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9267bc4-ae61-427d-ae46-1684063198c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6db33bd-cc08-4373-a561-84d76b32234a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0c1c8c-99cc-4077-a560-e9f1897701fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:11 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Volume volume-c6db33bd-cc08-4373-a561-84d76b32234a (c6db33bd-cc08-4373-a561-84d76b32234a): created successfully Aug 09 12:55:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b0c1c8c-99cc-4077-a560-e9f1897701fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (77c8f038-15fe-48a5-89fc-4e1f8f554aee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c11df47a-5633-4b10-8f9f-67903e8039a0 tempest-VolumesGetTest-1608686802 None] Created volume successfully. Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (11b105bd-f14a-4630-add7-85fe36167476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35cdf7d-c7ec-43df-8795-2765dc8b40a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a35cdf7d-c7ec-43df-8795-2765dc8b40a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-365882861',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11295b30-9d22-4f9d-9c5e-8942480d6d21,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e76d6387874e4533993c667097aeead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c6db33bd-cc08-4373-a561-84d76b32234a,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:14Z,use_quota=True,user_id='be60389d60a14878b6234a268c3843aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603a5c90-812c-44af-b69c-7b7c4a58f889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (603a5c90-812c-44af-b69c-7b7c4a58f889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4359e458-99f5-4323-aece-8edea7a8b9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4359e458-99f5-4323-aece-8edea7a8b9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '11295b30-9d22-4f9d-9c5e-8942480d6d21', 'volume_name': 'volume-11295b30-9d22-4f9d-9c5e-8942480d6d21', 'volume_size': 1, 'source_volid': 'c6db33bd-cc08-4373-a561-84d76b32234a', 'source_volstatus': 'available'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141531f7-b310-47ad-93ae-8b0d07021684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (141531f7-b310-47ad-93ae-8b0d07021684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6999760-b856-4d2d-9b2d-cefc37921c18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:13 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Volume 11295b30-9d22-4f9d-9c5e-8942480d6d21: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-11295b30-9d22-4f9d-9c5e-8942480d6d21', 'volume_size': 1, 'source_volid': 'c6db33bd-cc08-4373-a561-84d76b32234a', 'source_volstatus': 'available'} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:13 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Cloning volume c6db33bd-cc08-4373-a561-84d76b32234a to volume 11295b30-9d22-4f9d-9c5e-8942480d6d21 Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Creating offline snapshot 5751e327-17b4-483c-bbe9-7387fe287a2d of volume c6db33bd-cc08-4373-a561-84d76b32234a {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef46bae9-9f31-4040-b4e7-fa01f5019952]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:13 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a Aug 09 12:55:13 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:14 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a" returned: 0 in 0.395s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:14 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d 1G Aug 09 12:55:14 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:14 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d 1G" returned: 0 in 0.476s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6db33bd-cc08-4373-a561-84d76b32234a -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:14 devstack sudo[104132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6db33bd-cc08-4373-a561-84d76b32234a -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d Aug 09 12:55:14 devstack sudo[104132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:15 devstack sudo[104132]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c6db33bd-cc08-4373-a561-84d76b32234a -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d" returned: 0 in 0.376s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:15 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d is being set with open permissions: ugo+rw Aug 09 12:55:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:15 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d Aug 09 12:55:15 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:15 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d" returned: 0 in 0.299s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:15 devstack sudo[104142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.info Aug 09 12:55:15 devstack sudo[104142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:15 devstack sudo[104142]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.info" returned: 0 in 0.275s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:15 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.info is being set with open permissions: ugo+rw Aug 09 12:55:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:15 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.info Aug 09 12:55:15 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:15 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.info" returned: 0 in 0.262s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-quobyte-11295b30-9d22-4f9d-9c5e-8942480d6d21" by "_copy_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:55:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-11295b30-9d22-4f9d-9c5e-8942480d6d21" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:55:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] snapshot: 5751e327-17b4-483c-bbe9-7387fe287a2d, volume: 11295b30-9d22-4f9d-9c5e-8942480d6d21, {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 12:55:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:16 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[179e8b11-1849-4bee-a1f1-785b9ee5585a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:16 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d Aug 09 12:55:16 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:16 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d" returned: 0 in 0.420s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6db33bd-cc08-4373-a561-84d76b32234a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:55:16 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee9e50c-1c03-499d-ab36-c83150f4a127]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:16 devstack sudo[104153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a Aug 09 12:55:16 devstack sudo[104153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:17 devstack sudo[104153]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a" returned: 0 in 0.564s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 12:55:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Creating direct copy from snapshot {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 12:55:17 devstack cinder-volume[89309]: DEBUG cinder.utils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Path /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21 not found in is_blk_device check {{(pid=89309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 12:55:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:17 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21 Aug 09 12:55:17 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:22 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21" returned: 0 in 5.696s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:22 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:55:22 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Converted 1024.00 MB image at 179.74 MB/s Aug 09 12:55:22 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21 is being set with open permissions: ugo+rw Aug 09 12:55:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:22 devstack sudo[104174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21 Aug 09 12:55:22 devstack sudo[104174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:23 devstack sudo[104174]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21" returned: 0 in 0.345s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-11295b30-9d22-4f9d-9c5e-8942480d6d21" released by "_copy_volume_from_snapshot" :: held 7.164s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:55:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-quobyte-5751e327-17b4-483c-bbe9-7387fe287a2d" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:55:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-5751e327-17b4-483c-bbe9-7387fe287a2d" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:55:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Deleting offline snapshot 5751e327-17b4-483c-bbe9-7387fe287a2d of volume c6db33bd-cc08-4373-a561-84d76b32234a {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:55:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] snapshot_file for this snap is: volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:55:23 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b92eb6-fd4e-4d0c-ae42-b67db4fc2504]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:23 devstack sudo[104263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d Aug 09 12:55:23 devstack sudo[104263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:23 devstack sudo[104263]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d" returned: 0 in 0.435s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c6db33bd-cc08-4373-a561-84d76b32234a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:55:23 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d29e58a-19dd-43ce-82ad-6ec28b82d547]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:23 devstack sudo[104269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a Aug 09 12:55:23 devstack sudo[104269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:24 devstack sudo[104269]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a" returned: 0 in 0.614s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:24 devstack sudo[104274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d Aug 09 12:55:24 devstack sudo[104274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:24 devstack sudo[104274]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d" returned: 0 in 0.423s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:24 devstack sudo[104279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d Aug 09 12:55:24 devstack sudo[104279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:25 devstack sudo[104279]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a.5751e327-17b4-483c-bbe9-7387fe287a2d" returned: 0 in 0.311s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-5751e327-17b4-483c-bbe9-7387fe287a2d" released by "_delete_snapshot" :: held 1.912s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:55:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.395s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6999760-b856-4d2d-9b2d-cefc37921c18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11295b30-9d22-4f9d-9c5e-8942480d6d21', 'volume_size': 1, 'source_volid': 'c6db33bd-cc08-4373-a561-84d76b32234a', 'source_volstatus': 'available'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907351fb-7365-4007-85e5-3cf88f5a01a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:25 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Volume volume-11295b30-9d22-4f9d-9c5e-8942480d6d21 (11295b30-9d22-4f9d-9c5e-8942480d6d21): created successfully Aug 09 12:55:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (907351fb-7365-4007-85e5-3cf88f5a01a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (11b105bd-f14a-4630-add7-85fe36167476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:25 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8214f3c6-cadd-4f54-abf1-1655041a99df tempest-VolumesGetTest-1608686802 None] Created volume successfully. Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (e09f4f56-2145-4ff7-b42f-fc7987ecf28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7640f7-8626-494d-a154-95178a53db10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7640f7-8626-494d-a154-95178a53db10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1610163157',display_name='tempest-VolumesGetTest-Volume-786912439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72db618-9e5d-49fa-8f2c-0eb71ce59fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76d6387874e4533993c667097aeead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:27Z,use_quota=True,user_id='be60389d60a14878b6234a268c3843aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf16db7-2f9f-436a-ac81-d5635879dfb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf16db7-2f9f-436a-ac81-d5635879dfb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9686adec-0a6f-462d-aeba-bb736619e897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9686adec-0a6f-462d-aeba-bb736619e897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f72db618-9e5d-49fa-8f2c-0eb71ce59fb1', 'volume_name': 'volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358aa42c-a47a-4c91-aa9a-b3c4f8a654d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358aa42c-a47a-4c91-aa9a-b3c4f8a654d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f985c1-e55b-46e4-b73b-7ed439cd1e55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:27 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Volume f72db618-9e5d-49fa-8f2c-0eb71ce59fb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1', 'volume_size': 1} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:27Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1610163157',display_name='tempest-VolumesGetTest-Volume-786912439',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f72db618-9e5d-49fa-8f2c-0eb71ce59fb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76d6387874e4533993c667097aeead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:27Z,use_quota=True,user_id='be60389d60a14878b6234a268c3843aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Creating volume f72db618-9e5d-49fa-8f2c-0eb71ce59fb1 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:55:27 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:55:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:27 devstack sudo[104320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1 1073741824 Aug 09 12:55:27 devstack sudo[104320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Flow 'volume_create_manager' (463f003e-9475-4e41-b49e-a05e1f746055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761edfee-dfc8-4dd1-9617-62c85c732ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (761edfee-dfc8-4dd1-9617-62c85c732ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1485848574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da21d971-5a85-4a74-9fda-1b2c8f4dd56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bb0692d29497abb6e57cbb450734f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:28Z,use_quota=True,user_id='7a880fc421144bbcbc943ac83337d3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438fc116-de33-488f-ad79-ba7e8fc4bef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438fc116-de33-488f-ad79-ba7e8fc4bef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ac5b19-3895-4a7c-ace2-0b513fc6fe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45ac5b19-3895-4a7c-ace2-0b513fc6fe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da21d971-5a85-4a74-9fda-1b2c8f4dd56f', 'volume_name': 'volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7ddf88-0e5c-4db0-b110-ac057f5f3d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e7ddf88-0e5c-4db0-b110-ac057f5f3d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70af643e-e96d-4497-986b-66032a7faa5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:28 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Volume da21d971-5a85-4a74-9fda-1b2c8f4dd56f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f', 'volume_size': 1} Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:28 devstack sudo[104320]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1 1073741824" returned: 0 in 1.284s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:28 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1 Aug 09 12:55:28 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:28 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Flow 'volume_create_manager' (20fa3813-ecd5-44dd-a14e-02b4eabc73c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5620f9e4-970d-4d1b-9a54-801edb8fc702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5620f9e4-970d-4d1b-9a54-801edb8fc702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-451034777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2e207b-ad7c-42a4-ba39-bf702a17493a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bb0692d29497abb6e57cbb450734f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:29Z,use_quota=True,user_id='7a880fc421144bbcbc943ac83337d3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d28dacf-6a90-4492-a07f-bf425b932d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d28dacf-6a90-4492-a07f-bf425b932d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd0c7f4-da5b-4a09-ae5b-c903b6bcaaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cd0c7f4-da5b-4a09-ae5b-c903b6bcaaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f2e207b-ad7c-42a4-ba39-bf702a17493a', 'volume_name': 'volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0322829c-232b-4d45-8aef-d9b23d96ae16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0322829c-232b-4d45-8aef-d9b23d96ae16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110d0925-089c-4bd7-b18a-ee3697cd9024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:29 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Volume 1f2e207b-ad7c-42a4-ba39-bf702a17493a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a', 'volume_size': 1} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:29 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1" returned: 0 in 0.611s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] <== create_volume: return (2020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.023s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.124s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1485848574',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da21d971-5a85-4a74-9fda-1b2c8f4dd56f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bb0692d29497abb6e57cbb450734f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:28Z,use_quota=True,user_id='7a880fc421144bbcbc943ac83337d3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Creating volume da21d971-5a85-4a74-9fda-1b2c8f4dd56f {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:55:29 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:29 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f 1073741824 Aug 09 12:55:29 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f985c1-e55b-46e4-b73b-7ed439cd1e55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe4d844-581c-4a07-9c82-c161642b4a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:29 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Volume volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1 (f72db618-9e5d-49fa-8f2c-0eb71ce59fb1): created successfully Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe4d844-581c-4a07-9c82-c161642b4a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (e09f4f56-2145-4ff7-b42f-fc7987ecf28a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:29 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-89cb678d-87ea-4002-b8c4-4ecd697877b3 tempest-VolumesGetTest-1608686802 None] Created volume successfully. Aug 09 12:55:30 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f 1073741824" returned: 0 in 0.836s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:30 devstack sudo[104381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f Aug 09 12:55:30 devstack sudo[104381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:55:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Lock "cinder-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:55:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-quobyte-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:55:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:55:31 devstack sudo[104381]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f" returned: 0 in 0.629s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] <== create_volume: return (1544ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.550s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79c57d8-342c-4e70-b92f-3a7a16d87f89]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.858s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-451034777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f2e207b-ad7c-42a4-ba39-bf702a17493a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e06bb0692d29497abb6e57cbb450734f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:29Z,use_quota=True,user_id='7a880fc421144bbcbc943ac83337d3fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Creating volume 1f2e207b-ad7c-42a4-ba39-bf702a17493a {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:55:31 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:31 devstack sudo[104384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a 1073741824 Aug 09 12:55:31 devstack sudo[104384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70af643e-e96d-4497-986b-66032a7faa5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89fc458-ca2f-43e9-a039-b59c4854cead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:31 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Volume volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f (da21d971-5a85-4a74-9fda-1b2c8f4dd56f): created successfully Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c89fc458-ca2f-43e9-a039-b59c4854cead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Flow 'volume_create_manager' (463f003e-9475-4e41-b49e-a05e1f746055) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:31 devstack sudo[104385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1 Aug 09 12:55:31 devstack sudo[104385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:31 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-753d3ad3-9db9-48d8-a404-3d372bff34f2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Created volume successfully. Aug 09 12:55:31 devstack sudo[104385]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1" returned: 0 in 0.726s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:31 devstack sudo[104395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1 Aug 09 12:55:31 devstack sudo[104395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:31 devstack sudo[104384]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a 1073741824" returned: 0 in 0.925s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:32 devstack sudo[104397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a Aug 09 12:55:32 devstack sudo[104397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:32 devstack sudo[104395]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1" returned: 0 in 0.409s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1" released by "delete_volume" :: held 1.290s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Created reservations ['3ff02717-69a0-4734-a3ae-d597a5328e5c', 'c28fb385-f223-42dc-b62c-69a0ed47c811', 'a2484753-8736-421e-b618-1d9908ffb193', 'edb247df-85bd-46cd-8b3c-1ad661974cdc'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:32 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:55:32 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:32 devstack sudo[104397]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a" returned: 0 in 0.538s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (110d0925-089c-4bd7-b18a-ee3697cd9024) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5f29d6-0f22-42d8-9a86-c381c85a3d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:32 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Volume volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a (1f2e207b-ad7c-42a4-ba39-bf702a17493a): created successfully Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e5f29d6-0f22-42d8-9a86-c381c85a3d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Flow 'volume_create_manager' (20fa3813-ecd5-44dd-a14e-02b4eabc73c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:32 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b387f384-3a40-4095-8028-7c8b784afeff tempest-TestServerVolumeAttachmentScenario-735531593 None] Created volume successfully. Aug 09 12:55:32 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.436s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:55:32 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Deleted volume successfully. Aug 09 12:55:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fad12a62-30b9-4920-8f3c-da5e22d53edc tempest-VolumesGetTest-1608686802 None] Lock "cinder-f72db618-9e5d-49fa-8f2c-0eb71ce59fb1-delete_volume" released by "delete_volume" :: held 2.113s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:55:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-11295b30-9d22-4f9d-9c5e-8942480d6d21-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:55:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Lock "cinder-11295b30-9d22-4f9d-9c5e-8942480d6d21-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:55:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-quobyte-11295b30-9d22-4f9d-9c5e-8942480d6d21" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:55:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-11295b30-9d22-4f9d-9c5e-8942480d6d21" acquired by "delete_volume" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:55:33 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47a56fc-ae89-494c-a2fc-ac345e869150]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:33 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21 Aug 09 12:55:33 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:33 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21" returned: 0 in 0.456s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:34 devstack sudo[104410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21 Aug 09 12:55:34 devstack sudo[104410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:34 devstack sudo[104410]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-11295b30-9d22-4f9d-9c5e-8942480d6d21" returned: 0 in 0.296s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-11295b30-9d22-4f9d-9c5e-8942480d6d21" released by "delete_volume" :: held 0.842s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:55:34 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Created reservations ['4a793e4c-2ab5-4c4b-83c6-1a578a510685', 'e7c9c0a7-286a-46e4-b22d-f80c0d6dfe0a', 'fdec387c-0219-4c2b-8eb6-b146e105fd43', '190f635f-a6df-47cc-953a-4485034a46bd'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:55:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:34 devstack sudo[104413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:55:34 devstack sudo[104413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-c6db33bd-cc08-4373-a561-84d76b32234a-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:55:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Lock "cinder-c6db33bd-cc08-4373-a561-84d76b32234a-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:55:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-quobyte-c6db33bd-cc08-4373-a561-84d76b32234a" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:55:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-c6db33bd-cc08-4373-a561-84d76b32234a" acquired by "delete_volume" :: waited 0.037s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:55:34 devstack sudo[104413]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.446s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:35 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:55:35 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Deleted volume successfully. Aug 09 12:55:35 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa370f7-8a4d-4dcd-acbe-1d6ab0891e36]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c83a1793-9dc7-4695-b3af-2b2a35945655 tempest-VolumesGetTest-1608686802 None] Lock "cinder-11295b30-9d22-4f9d-9c5e-8942480d6d21-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:55:35 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a Aug 09 12:55:35 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:35 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a" returned: 0 in 0.526s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:35 devstack sudo[104424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a Aug 09 12:55:35 devstack sudo[104424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:35 devstack sudo[104424]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c6db33bd-cc08-4373-a561-84d76b32234a" returned: 0 in 0.349s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-c6db33bd-cc08-4373-a561-84d76b32234a" released by "delete_volume" :: held 1.011s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:55:36 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:DELETE=16,cinder:SELECT=84,cinder:INSERT=30,cinder:UPDATE=101 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:55:36 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Created reservations ['89f71c57-7988-4bcc-b97f-58843bc35dbf', 'd4c4ab7e-e000-4cf3-ac43-91271ba63357', '9b233155-c33b-497c-8769-e286dfb9f40a', '7a752dc6-977b-4e3f-97f1-e9d75b4a5098'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:55:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:36 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:55:36 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:36 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.627s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:36 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:55:36 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Deleted volume successfully. Aug 09 12:55:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bcb2c2fc-d646-4f59-b6c4-14647174d0a7 tempest-VolumesGetTest-1608686802 None] Lock "cinder-c6db33bd-cc08-4373-a561-84d76b32234a-delete_volume" released by "delete_volume" :: held 2.163s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:55:39 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:55:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (c73a3052-b691-41a6-9f53-b6ebd09c3dc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe12933f-919c-49c7-bdef-691bdbcd3d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe12933f-919c-49c7-bdef-691bdbcd3d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-677347157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8369f045-2bb7-4373-b856-055086f4a4a6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e76d6387874e4533993c667097aeead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:39Z,use_quota=True,user_id='be60389d60a14878b6234a268c3843aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee78f8e-6f1b-4089-9332-fe8b94954aec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ee78f8e-6f1b-4089-9332-fe8b94954aec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac55afc7-af8e-4af8-b63c-06a624f70a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:39 devstack cinder-volume[89309]: DEBUG cinder.image.glance [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Creating Keystone auth plugin from conf {{(pid=89309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 12:55:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac55afc7-af8e-4af8-b63c-06a624f70a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8369f045-2bb7-4373-b856-055086f4a4a6', 'volume_name': 'volume-8369f045-2bb7-4373-b856-055086f4a4a6', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c1b0bf-377d-4ecd-9796-87e55be82ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c1b0bf-377d-4ecd-9796-87e55be82ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4776279-3d09-49ae-98ca-1484ff6b1010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:39 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Volume 8369f045-2bb7-4373-b856-055086f4a4a6: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8369f045-2bb7-4373-b856-055086f4a4a6', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 09 12:55:39 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Trying to clone 8369f045-2bb7-4373-b856-055086f4a4a6 from image edd103c7-208a-494c-8e8e-975b743b3cc4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]). {{(pid=89309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 12:55:40 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 12:55:40 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Image download 20.69 MB at 20.69 MB/s Aug 09 12:55:40 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfdcb8df-46f7-44bf-80eb-75290e1b77ba]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:40 devstack sudo[104458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD Aug 09 12:55:40 devstack sudo[104458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:40 devstack sudo[104458]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD" returned: 0 in 0.448s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:40 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Temporary image edd103c7-208a-494c-8e8e-975b743b3cc4 is fetched for user be60389d60a14878b6234a268c3843aa. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9575c12-7eb8-4bd6-8f22-97d1dd02cb4e]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:41 devstack sudo[104463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD Aug 09 12:55:41 devstack sudo[104463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:41 devstack sudo[104463]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD" returned: 0 in 0.463s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-677347157',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8369f045-2bb7-4373-b856-055086f4a4a6,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='e76d6387874e4533993c667097aeead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:39Z,use_quota=True,user_id='be60389d60a14878b6234a268c3843aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Creating volume 8369f045-2bb7-4373-b856-055086f4a4a6 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:55:41 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:55:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:41 devstack sudo[104468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 1073741824 Aug 09 12:55:41 devstack sudo[104468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:42 devstack sudo[104468]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 1073741824" returned: 0 in 1.273s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:42 devstack sudo[104524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 Aug 09 12:55:42 devstack sudo[104524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:43 devstack sudo[104524]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6" returned: 0 in 0.484s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] <== create_volume: return (1830ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.836s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Attempting download of edd103c7-208a-494c-8e8e-975b743b3cc4 ((None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}])) to volume 8369f045-2bb7-4373-b856-055086f4a4a6. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b75defb-459f-4c4d-ac88-5db0f859742a]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_42o0rstw {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Flow 'volume_create_manager' (597f68a2-a558-46db-9e7f-d528c052e56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f9f230-a5a2-4003-8389-e5fd3a3accd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6f9f230-a5a2-4003-8389-e5fd3a3accd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-867973800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfd2d97-55e3-4522-945d-29dddf46712f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3342a0ae59684a5bb543d77eb8de04dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:44Z,use_quota=True,user_id='f85521ad7f5c461c8def374c81fb2b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90931565-f208-4bbb-a830-35096a607c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:43 devstack sudo[104530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_42o0rstw Aug 09 12:55:43 devstack sudo[104530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90931565-f208-4bbb-a830-35096a607c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bfc2bc-c4a5-476d-9cb2-037f62e54082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bfc2bc-c4a5-476d-9cb2-037f62e54082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dfd2d97-55e3-4522-945d-29dddf46712f', 'volume_name': 'volume-7dfd2d97-55e3-4522-945d-29dddf46712f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c85844a-75c1-49cc-b52d-26ec989b0d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c85844a-75c1-49cc-b52d-26ec989b0d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f11346-dd23-4056-95b9-8a69901f1f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:43 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Volume 7dfd2d97-55e3-4522-945d-29dddf46712f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dfd2d97-55e3-4522-945d-29dddf46712f', 'volume_size': 1} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-867973800',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dfd2d97-55e3-4522-945d-29dddf46712f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3342a0ae59684a5bb543d77eb8de04dc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:44Z,use_quota=True,user_id='f85521ad7f5c461c8def374c81fb2b5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Creating volume 7dfd2d97-55e3-4522-945d-29dddf46712f {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:55:43 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:43 devstack sudo[104532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f 1073741824 Aug 09 12:55:43 devstack sudo[104532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:43 devstack sudo[104530]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_42o0rstw" returned: 0 in 0.419s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_42o0rstw {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:44 devstack sudo[104536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_42o0rstw Aug 09 12:55:44 devstack sudo[104536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:44 devstack sudo[104532]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f 1073741824" returned: 0 in 0.544s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:44 devstack sudo[104536]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_42o0rstw" returned: 1 in 0.373s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:44 devstack sudo[104544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f Aug 09 12:55:44 devstack sudo[104544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_42o0rstw' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf337579-c51a-4ed0-8f61-d5ae47786f04]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:44 devstack sudo[104546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD Aug 09 12:55:44 devstack sudo[104546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:44 devstack sudo[104544]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f" returned: 0 in 0.314s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58f11346-dd23-4056-95b9-8a69901f1f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dfd2d97-55e3-4522-945d-29dddf46712f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8f8ab7-4c01-4b8f-9e74-750e3a39bb91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:44 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Volume volume-7dfd2d97-55e3-4522-945d-29dddf46712f (7dfd2d97-55e3-4522-945d-29dddf46712f): created successfully Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8f8ab7-4c01-4b8f-9e74-750e3a39bb91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Flow 'volume_create_manager' (597f68a2-a558-46db-9e7f-d528c052e56c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-04483b6b-02e7-4eca-8f5b-59767d34062b tempest-TestImageHashVerification-1617381041 None] Created volume successfully. Aug 09 12:55:44 devstack sudo[104546]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD" returned: 0 in 0.381s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] edd103c7-208a-494c-8e8e-975b743b3cc4 was qcow2, converting to qcow2 {{(pid=89309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 12:55:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:44 devstack sudo[104552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 Aug 09 12:55:44 devstack sudo[104552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a30acc1-196e-49eb-b587-73d05a0ef4aa]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:47 devstack sudo[104628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f Aug 09 12:55:47 devstack sudo[104628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:47 devstack sudo[104552]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6" returned: 0 in 2.762s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_qzqjafm7devstack@QuobyteHD, size 112.00 MB, duration 2.76 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:55:47 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Converted 112.00 MB image at 40.53 MB/s Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:47 devstack sudo[104635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 1G Aug 09 12:55:47 devstack sudo[104635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:47 devstack sudo[104628]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f" returned: 0 in 0.446s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[85632e6b-1e9c-442a-ad35-0dacddda5c88]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:47 devstack sudo[104635]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 1G" returned: 0 in 0.368s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Downloaded image edd103c7-208a-494c-8e8e-975b743b3cc4 ((None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}])) to volume 8369f045-2bb7-4373-b856-055086f4a4a6 successfully. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Temporary image edd103c7-208a-494c-8e8e-975b743b3cc4 for user be60389d60a14878b6234a268c3843aa is deleted. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Marking volume 8369f045-2bb7-4373-b856-055086f4a4a6 as bootable. {{(pid=89309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:INSERT=26,cinder:UPDATE=122,cinder:SELECT=63,cinder:DELETE=5 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Copying metadata from image edd103c7-208a-494c-8e8e-975b743b3cc4 to 8369f045-2bb7-4373-b856-055086f4a4a6. {{(pid=89309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Creating volume glance metadata for volume 8369f045-2bb7-4373-b856-055086f4a4a6 backed by image edd103c7-208a-494c-8e8e-975b743b3cc4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 12:55:47 devstack sudo[104653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f Aug 09 12:55:47 devstack sudo[104653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4776279-3d09-49ae-98ca-1484ff6b1010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8369f045-2bb7-4373-b856-055086f4a4a6', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5773fb7b-91e2-4118-bf69-66103bce88bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:47 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Volume volume-8369f045-2bb7-4373-b856-055086f4a4a6 (8369f045-2bb7-4373-b856-055086f4a4a6): created successfully Aug 09 12:55:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5773fb7b-91e2-4118-bf69-66103bce88bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (c73a3052-b691-41a6-9f53-b6ebd09c3dc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-aac96a6d-5c4f-4c58-9689-b9b04f577a48 tempest-VolumesGetTest-1608686802 None] Created volume successfully. Aug 09 12:55:48 devstack sudo[104653]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f" returned: 0 in 0.443s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f /opt/stack/data/cinder/conversion/7dfd2d97-55e3-4522-945d-29dddf46712f.temp_image.b40e307f-4678-4dbe-b205-56e231c60497usqe23qi.img {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:48 devstack sudo[104658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f /opt/stack/data/cinder/conversion/7dfd2d97-55e3-4522-945d-29dddf46712f.temp_image.b40e307f-4678-4dbe-b205-56e231c60497usqe23qi.img Aug 09 12:55:48 devstack sudo[104658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:51 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:55:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (c61ebb86-0f82-4821-b99c-7256e89501b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:55:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9118e64-32b4-48f9-a6dd-2cc26f16fd97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9118e64-32b4-48f9-a6dd-2cc26f16fd97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1605720334',display_name='tempest-VolumesGetTest-Volume-1002128665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed7a8ac-c902-4210-9357-3d50d2a9bb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76d6387874e4533993c667097aeead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:51Z,use_quota=True,user_id='be60389d60a14878b6234a268c3843aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8092d8a6-576b-4030-9952-3ce11cb17bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8092d8a6-576b-4030-9952-3ce11cb17bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9241018f-697d-4648-9461-23dcaf3b65f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9241018f-697d-4648-9461-23dcaf3b65f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed7a8ac-c902-4210-9357-3d50d2a9bb85', 'volume_name': 'volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc2bd4c-b44b-4d4e-adad-4d4be01745e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfc2bd4c-b44b-4d4e-adad-4d4be01745e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:55:52 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f617d39-a139-4550-a5b4-d209d436c66e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:55:52 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Volume eed7a8ac-c902-4210-9357-3d50d2a9bb85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85', 'volume_size': 1} Aug 09 12:55:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:55 devstack sudo[104658]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f /opt/stack/data/cinder/conversion/7dfd2d97-55e3-4522-945d-29dddf46712f.temp_image.b40e307f-4678-4dbe-b205-56e231c60497usqe23qi.img" returned: 0 in 7.135s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:55 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bc5fab-596c-4200-b538-6b732b3cb168]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:55:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:55 devstack sudo[104687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f Aug 09 12:55:55 devstack sudo[104687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:56 devstack sudo[104687]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f" returned: 0 in 0.819s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:56 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f, size 1024.00 MB, duration 7.14 sec, destination /opt/stack/data/cinder/conversion/7dfd2d97-55e3-4522-945d-29dddf46712f.temp_image.b40e307f-4678-4dbe-b205-56e231c60497usqe23qi.img {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:55:56 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] Converted 1024.00 MB image at 143.49 MB/s Aug 09 12:55:56 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] b40e307f-4678-4dbe-b205-56e231c60497 was raw, no need to convert to raw {{(pid=89309) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Aug 09 12:55:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-73ea0434-daf8-4765-8b33-5edc69c2b150 req-853c9741-337e-44af-b7dd-8ee5efacacc0 tempest-TestStampPattern-316392764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:55:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:55:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:55:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:55:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:55:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:55:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:55:57 devstack sudo[104703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:55:57 devstack sudo[104703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:55:58 devstack sudo[104703]: pam_unix(sudo:session): session closed for user root Aug 09 12:55:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.349s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:55:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:55:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:55:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:55:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:56:06 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=11,cinder:SELECT=24,cinder:INSERT=7,cinder:DELETE=2 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:56:06 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=6,cinder:INSERT=7,cinder:UPDATE=3 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:56:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 28.194s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] Uploaded volume to glance image-id: b40e307f-4678-4dbe-b205-56e231c60497. {{(pid=89309) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Aug 09 12:56:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.460s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:55:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1605720334',display_name='tempest-VolumesGetTest-Volume-1002128665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed7a8ac-c902-4210-9357-3d50d2a9bb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e76d6387874e4533993c667097aeead3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:55:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:55:51Z,use_quota=True,user_id='be60389d60a14878b6234a268c3843aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:56:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Creating volume eed7a8ac-c902-4210-9357-3d50d2a9bb85 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:56:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:56:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:56:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:56:15 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:56:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:15 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8e5a88f3-c3ab-4a5f-b4fc-b24c68faf0be tempest-TestImageHashVerification-1617381041 None] Copy volume to image completed successfully. Aug 09 12:56:15 devstack sudo[104734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85 1073741824 Aug 09 12:56:15 devstack sudo[104734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:16 devstack sudo[104734]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85 1073741824" returned: 0 in 0.531s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:16 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85 Aug 09 12:56:16 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:16 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85" returned: 0 in 0.302s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-73ea0434-daf8-4765-8b33-5edc69c2b150 req-853c9741-337e-44af-b7dd-8ee5efacacc0 tempest-TestStampPattern-316392764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 19.858s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Acquiring lock "cinder-7dfd2d97-55e3-4522-945d-29dddf46712f-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-73ea0434-daf8-4765-8b33-5edc69c2b150 req-853c9741-337e-44af-b7dd-8ee5efacacc0 tempest-TestStampPattern-316392764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f617d39-a139-4550-a5b4-d209d436c66e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b4a0f4-0f49-44f7-a5a6-a3f375105178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Lock "cinder-7dfd2d97-55e3-4522-945d-29dddf46712f-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:16 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Volume volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85 (eed7a8ac-c902-4210-9357-3d50d2a9bb85): created successfully Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6b4a0f4-0f49-44f7-a5a6-a3f375105178) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Flow 'volume_create_manager' (c61ebb86-0f82-4821-b99c-7256e89501b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-73ea0434-daf8-4765-8b33-5edc69c2b150 req-853c9741-337e-44af-b7dd-8ee5efacacc0 tempest-TestStampPattern-316392764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '96d29f16-8a7d-4d2b-8aa1-12f619185546', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:56:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-835e8572-8ece-42ed-94c1-ac9df2d70b50 tempest-VolumesGetTest-1608686802 None] Created volume successfully. Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Acquiring lock "cinder-quobyte-7dfd2d97-55e3-4522-945d-29dddf46712f" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-9b026027-81f6-4191-af18-6d53c795687c req-b1bd0ccb-87a5-4475-a75e-5fbc864e2f06 tempest-TestServerVolumeAttachmentScenario-735531593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-9b026027-81f6-4191-af18-6d53c795687c req-b1bd0ccb-87a5-4475-a75e-5fbc864e2f06 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Lock "cinder-quobyte-7dfd2d97-55e3-4522-945d-29dddf46712f" acquired by "delete_volume" :: waited 0.049s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-9b026027-81f6-4191-af18-6d53c795687c req-b1bd0ccb-87a5-4475-a75e-5fbc864e2f06 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.030s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a142e79a-d32e-46f4-8ccc-99bd6647f1c5]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-73ea0434-daf8-4765-8b33-5edc69c2b150 req-853c9741-337e-44af-b7dd-8ee5efacacc0 tempest-TestStampPattern-316392764 None] attachment_update completed successfully. Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-9b026027-81f6-4191-af18-6d53c795687c req-b1bd0ccb-87a5-4475-a75e-5fbc864e2f06 tempest-TestServerVolumeAttachmentScenario-735531593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '69068ff0-af53-4dc0-bfec-3d8adb1bcdc5', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:56:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-9b026027-81f6-4191-af18-6d53c795687c req-b1bd0ccb-87a5-4475-a75e-5fbc864e2f06 tempest-TestServerVolumeAttachmentScenario-735531593 None] attachment_update completed successfully. Aug 09 12:56:16 devstack sudo[104754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f Aug 09 12:56:16 devstack sudo[104754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:16 devstack sudo[104754]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f" returned: 0 in 0.411s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:17 devstack sudo[105143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f Aug 09 12:56:17 devstack sudo[105143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:17 devstack sudo[105143]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7dfd2d97-55e3-4522-945d-29dddf46712f" returned: 0 in 0.260s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Lock "cinder-quobyte-7dfd2d97-55e3-4522-945d-29dddf46712f" released by "delete_volume" :: held 0.711s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Created reservations ['df621f61-0783-434a-9039-f584ec9bf684', '2a1fce67-4e14-437d-b73e-f103757199e5', '13858f71-876d-4d0e-bcdd-b81bbbe524e7', '47e7f598-21dd-4f8a-bb41-7bd49296d0e4'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:17 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:56:17 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:17 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.399s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:56:17 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Deleted volume successfully. Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-eed7a8ac-c902-4210-9357-3d50d2a9bb85-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-70b83688-450e-4292-b140-cc06f77a22cc tempest-TestImageHashVerification-1617381041 None] Lock "cinder-7dfd2d97-55e3-4522-945d-29dddf46712f-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Lock "cinder-eed7a8ac-c902-4210-9357-3d50d2a9bb85-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-quobyte-eed7a8ac-c902-4210-9357-3d50d2a9bb85" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-eed7a8ac-c902-4210-9357-3d50d2a9bb85" acquired by "delete_volume" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:18 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7fcb08f-f2e2-4cf4-bf90-9bd727a04ee6]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:18 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85 Aug 09 12:56:18 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:18 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85" returned: 0 in 0.466s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:18 devstack sudo[105171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85 Aug 09 12:56:18 devstack sudo[105171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:18 devstack sudo[105171]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-eed7a8ac-c902-4210-9357-3d50d2a9bb85" returned: 0 in 0.285s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-eed7a8ac-c902-4210-9357-3d50d2a9bb85" released by "delete_volume" :: held 0.808s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:18 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Created reservations ['db68a6d6-e3ac-4ab8-87cf-7f14d89f8360', 'e274b13e-8e91-43fc-b6e3-3f7e4f355d2f', '7ba98667-180a-4bf6-b28e-8972727eea1e', 'c352cfc0-0be5-41a6-9d33-5931d0b8331a'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:19 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:56:19 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-8369f045-2bb7-4373-b856-055086f4a4a6-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Lock "cinder-8369f045-2bb7-4373-b856-055086f4a4a6-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Acquiring lock "cinder-quobyte-8369f045-2bb7-4373-b856-055086f4a4a6" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-8369f045-2bb7-4373-b856-055086f4a4a6" acquired by "delete_volume" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[103fe991-80fc-44fb-912a-f55db2f89374]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:19 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.404s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:56:19 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Deleted volume successfully. Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5b4bb9a4-aeb8-4e6e-938f-01f76cda46f3 tempest-VolumesGetTest-1608686802 None] Lock "cinder-eed7a8ac-c902-4210-9357-3d50d2a9bb85-delete_volume" released by "delete_volume" :: held 1.599s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:19 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 Aug 09 12:56:19 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:19 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6" returned: 0 in 0.518s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:19 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6 Aug 09 12:56:19 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:20 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8369f045-2bb7-4373-b856-055086f4a4a6" returned: 0 in 0.350s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Lock "cinder-quobyte-8369f045-2bb7-4373-b856-055086f4a4a6" released by "delete_volume" :: held 0.917s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:20 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Created reservations ['74ebb038-ba82-4bff-b40a-8f4bd5e43d57', '4f404ba5-aa68-44fd-b8a4-c1646ab4fb4c', '5fdc9322-28c7-43bc-a375-325354f28f62', 'b86b2c71-d843-410c-93b1-99d246e3edf3'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:56:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:56:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:56:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:20 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:56:20 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:20 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.427s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:20 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:56:20 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Deleted volume successfully. Aug 09 12:56:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e338db97-f3ab-4100-95fe-fc2bf72a2e8f tempest-VolumesGetTest-1608686802 None] Lock "cinder-8369f045-2bb7-4373-b856-055086f4a4a6-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-e77d8c32-abea-4ce2-a64c-0fba34bd0496 req-8974b3b4-d8d8-4741-8ccd-701bdf112929 tempest-TestServerVolumeAttachmentScenario-735531593 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-e77d8c32-abea-4ce2-a64c-0fba34bd0496 req-8974b3b4-d8d8-4741-8ccd-701bdf112929 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-e77d8c32-abea-4ce2-a64c-0fba34bd0496 req-8974b3b4-d8d8-4741-8ccd-701bdf112929 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-e77d8c32-abea-4ce2-a64c-0fba34bd0496 req-8974b3b4-d8d8-4741-8ccd-701bdf112929 tempest-TestServerVolumeAttachmentScenario-735531593 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce90e86f-db37-436c-a432-e4d332cc8049', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:56:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-f1445c02-8702-4991-8f8a-083331e28bec req-d6a63e97-0bc1-4af1-9d1d-34dd400c44ad tempest-TestStampPattern-316392764 None] Terminate volume connection completed successfully. Aug 09 12:56:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-f1445c02-8702-4991-8f8a-083331e28bec req-d6a63e97-0bc1-4af1-9d1d-34dd400c44ad tempest-TestStampPattern-316392764 None] Deleting attachment 96d29f16-8a7d-4d2b-8aa1-12f619185546. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:56:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-e77d8c32-abea-4ce2-a64c-0fba34bd0496 req-8974b3b4-d8d8-4741-8ccd-701bdf112929 tempest-TestServerVolumeAttachmentScenario-735531593 None] attachment_update completed successfully. Aug 09 12:56:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] Creating offline snapshot aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 of volume 3e4e7c94-cb65-44ff-b270-924e9bbc3afa {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:56:23 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa9c221-2a0b-4f33-9bf4-a3dab8fc9cbf]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:23 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa Aug 09 12:56:23 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:23 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa" returned: 0 in 0.459s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:23 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 1G Aug 09 12:56:23 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:24 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 1G" returned: 0 in 0.529s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:24 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 Aug 09 12:56:24 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:24 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7" returned: 0 in 0.423s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:24 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 is being set with open permissions: ugo+rw Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:24 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 Aug 09 12:56:24 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Flow 'volume_create_manager' (766571b8-3c9e-40a1-9d36-a936adaeadcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671dd17e-b20b-4715-98f7-5d18a493239c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671dd17e-b20b-4715-98f7-5d18a493239c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2054104373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d112ff8c-3b08-4bf0-b542-d4b924bd9842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1463aad0b89548bb84964ebf0352acf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:56:25Z,use_quota=True,user_id='fa5da401a8464b7d8abbc1f156411602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e28ee74-f3ec-40cd-9677-73bb330fd014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e28ee74-f3ec-40cd-9677-73bb330fd014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f38686-9eb5-475f-a4fc-2be211ea7f21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91f38686-9eb5-475f-a4fc-2be211ea7f21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd112ff8c-3b08-4bf0-b542-d4b924bd9842', 'volume_name': 'volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2ed37f-66df-491a-a873-7e19169bc613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be2ed37f-66df-491a-a873-7e19169bc613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40c11a7-32da-4d5f-9885-a91c41109865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:24 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Volume d112ff8c-3b08-4bf0-b542-d4b924bd9842: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842', 'volume_size': 1} Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:24 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7" returned: 0 in 0.366s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:25 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.info Aug 09 12:56:25 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:25 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.info" returned: 0 in 0.270s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:25 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.info is being set with open permissions: ugo+rw Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:25 devstack sudo[105251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.info Aug 09 12:56:25 devstack sudo[105251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:25 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-cf6ca592-73ca-4a15-a671-d8deca91694f req-76fa7bdb-4f8c-4f32-8e95-8d77e46b49df tempest-TestServerVolumeAttachmentScenario-735531593 None] Terminate volume connection completed successfully. Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-cf6ca592-73ca-4a15-a671-d8deca91694f req-76fa7bdb-4f8c-4f32-8e95-8d77e46b49df tempest-TestServerVolumeAttachmentScenario-735531593 None] Deleting attachment ce90e86f-db37-436c-a432-e4d332cc8049. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:56:25 devstack sudo[105251]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.info" returned: 0 in 0.303s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.470s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.729s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-2054104373',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d112ff8c-3b08-4bf0-b542-d4b924bd9842,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1463aad0b89548bb84964ebf0352acf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:56:25Z,use_quota=True,user_id='fa5da401a8464b7d8abbc1f156411602',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Creating volume d112ff8c-3b08-4bf0-b542-d4b924bd9842 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:56:25 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:56:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:25 devstack sudo[105256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842 1073741824 Aug 09 12:56:25 devstack sudo[105256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:25 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-152f2e90-df72-40d8-a22f-2b102c58a54f tempest-TestStampPattern-316392764 None] Create snapshot completed successfully Aug 09 12:56:26 devstack sudo[105256]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842 1073741824" returned: 0 in 0.507s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:26 devstack sudo[105262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842 Aug 09 12:56:26 devstack sudo[105262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:26 devstack sudo[105262]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842" returned: 0 in 0.329s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:56:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b40c11a7-32da-4d5f-9885-a91c41109865) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7db7ac1-7f35-47ed-b10f-a994d45572e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:26 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Volume volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842 (d112ff8c-3b08-4bf0-b542-d4b924bd9842): created successfully Aug 09 12:56:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7db7ac1-7f35-47ed-b10f-a994d45572e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Flow 'volume_create_manager' (766571b8-3c9e-40a1-9d36-a936adaeadcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:56:26 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e06c6da1-0614-400e-b27d-a5513eafe30a tempest-VolumesNegativeTest-517560387 None] Created volume successfully. Aug 09 12:56:27 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-53f83cdb-03d7-49ab-8246-c812111e955c req-814ff46e-279f-42f9-9d65-88bdb9cf450c tempest-TestServerVolumeAttachmentScenario-735531593 None] Terminate volume connection completed successfully. Aug 09 12:56:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-53f83cdb-03d7-49ab-8246-c812111e955c req-814ff46e-279f-42f9-9d65-88bdb9cf450c tempest-TestServerVolumeAttachmentScenario-735531593 None] Deleting attachment 69068ff0-af53-4dc0-bfec-3d8adb1bcdc5. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:56:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Acquiring lock "cinder-1f2e207b-ad7c-42a4-ba39-bf702a17493a-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "cinder-1f2e207b-ad7c-42a4-ba39-bf702a17493a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Acquiring lock "cinder-quobyte-1f2e207b-ad7c-42a4-ba39-bf702a17493a" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "cinder-quobyte-1f2e207b-ad7c-42a4-ba39-bf702a17493a" acquired by "delete_volume" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:34 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4808adc4-c450-488e-8fd5-8effba6d544d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:34 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a Aug 09 12:56:34 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:35 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a" returned: 0 in 0.817s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:35 devstack sudo[105426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a Aug 09 12:56:35 devstack sudo[105426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:35 devstack sudo[105426]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1f2e207b-ad7c-42a4-ba39-bf702a17493a" returned: 0 in 0.494s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "cinder-quobyte-1f2e207b-ad7c-42a4-ba39-bf702a17493a" released by "delete_volume" :: held 1.412s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:35 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Created reservations ['d767c9a6-86bf-4580-b378-fb5a7888b377', '0ffd59d0-93da-4c45-8b27-21be361813b1', '1f8b160c-dcab-4fd6-8f74-a841de51f9c8', '96ebaaeb-be47-4c01-8c1e-24f6d3bdbf68'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:36 devstack sudo[105458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:56:36 devstack sudo[105458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:36 devstack sudo[105458]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.350s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:56:36 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Deleted volume successfully. Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-59c460e3-6a1c-46fb-a661-3e7b49d6ccea tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "cinder-1f2e207b-ad7c-42a4-ba39-bf702a17493a-delete_volume" released by "delete_volume" :: held 2.158s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Acquiring lock "cinder-da21d971-5a85-4a74-9fda-1b2c8f4dd56f-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "cinder-da21d971-5a85-4a74-9fda-1b2c8f4dd56f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Acquiring lock "cinder-quobyte-da21d971-5a85-4a74-9fda-1b2c8f4dd56f" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "cinder-quobyte-da21d971-5a85-4a74-9fda-1b2c8f4dd56f" acquired by "delete_volume" :: waited 0.057s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[69989080-b943-40a9-a222-ab4fa536faaa]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:56:37 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f Aug 09 12:56:37 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Flow 'volume_create_manager' (7a1b0502-7f28-4c20-865d-9309b13964c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c473d170-f55e-474b-9f11-f68fbd9f42e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c473d170-f55e-474b-9f11-f68fbd9f42e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:56:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-187832709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f756d9ff-39ad-41e3-b69d-00f74d93df25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='308c6a5d61294bb591d013be9e9e17b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:56:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=aaf8f8fc-dbf0-4246-922c-6d81bb6632a7,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:56:37Z,use_quota=True,user_id='c8a57da4812a4ec7980d54ca18486e99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b292ddd9-235e-45e0-84bb-7ad3ba0ea893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b292ddd9-235e-45e0-84bb-7ad3ba0ea893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99eddc87-b307-47d1-a2ee-5c934af5cd83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99eddc87-b307-47d1-a2ee-5c934af5cd83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f756d9ff-39ad-41e3-b69d-00f74d93df25', 'volume_name': 'volume-f756d9ff-39ad-41e3-b69d-00f74d93df25', 'volume_size': 1, 'snapshot_id': 'aaf8f8fc-dbf0-4246-922c-6d81bb6632a7'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be06ef3a-5f11-4f4b-89f4-388bc00c6594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be06ef3a-5f11-4f4b-89f4-388bc00c6594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67ac344-dd84-464b-97ac-9b98b8191098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:37 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Volume f756d9ff-39ad-41e3-b69d-00f74d93df25: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f756d9ff-39ad-41e3-b69d-00f74d93df25', 'volume_size': 1, 'snapshot_id': 'aaf8f8fc-dbf0-4246-922c-6d81bb6632a7'} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Acquiring lock "cinder-quobyte-aaf8f8fc-dbf0-4246-922c-6d81bb6632a7-f756d9ff-39ad-41e3-b69d-00f74d93df25" by "_create_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Lock "cinder-quobyte-aaf8f8fc-dbf0-4246-922c-6d81bb6632a7-f756d9ff-39ad-41e3-b69d-00f74d93df25" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Creating volume f756d9ff-39ad-41e3-b69d-00f74d93df25 from snapshot aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 {{(pid=89309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Acquiring lock "cinder-quobyte-f756d9ff-39ad-41e3-b69d-00f74d93df25" by "_copy_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Lock "cinder-quobyte-f756d9ff-39ad-41e3-b69d-00f74d93df25" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] snapshot: aaf8f8fc-dbf0-4246-922c-6d81bb6632a7, volume: f756d9ff-39ad-41e3-b69d-00f74d93df25, {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fdccd63-3922-47fb-880a-253b805bdf5e]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:37 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f" returned: 0 in 0.709s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:37 devstack sudo[105484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f Aug 09 12:56:37 devstack sudo[105484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:37 devstack sudo[105481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 Aug 09 12:56:37 devstack sudo[105481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:38 devstack sudo[105484]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-da21d971-5a85-4a74-9fda-1b2c8f4dd56f" returned: 0 in 0.538s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "cinder-quobyte-da21d971-5a85-4a74-9fda-1b2c8f4dd56f" released by "delete_volume" :: held 1.321s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Created reservations ['121c4d9b-c288-4ab3-aade-3d3ba46fc27e', '323a18ab-67e1-4f20-bd24-41760ef1ad89', 'bb64bef0-ee73-4817-af43-1e9717b58b29', '06dfa2ab-c7c5-4c86-bb5d-3890cd02883e'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:38 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:56:38 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:38 devstack sudo[105481]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7" returned: 0 in 1.032s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa32230d-59d4-4d45-974e-37d2661890a9]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:38 devstack sudo[105494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa Aug 09 12:56:38 devstack sudo[105494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:38 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.357s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:56:38 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Deleted volume successfully. Aug 09 12:56:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7abe9cf9-b843-4e1a-9cf9-3df0b05332d2 tempest-TestServerVolumeAttachmentScenario-735531593 None] Lock "cinder-da21d971-5a85-4a74-9fda-1b2c8f4dd56f-delete_volume" released by "delete_volume" :: held 2.055s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:39 devstack sudo[105494]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa" returned: 0 in 0.601s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 12:56:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Creating direct copy from snapshot {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 12:56:39 devstack cinder-volume[89309]: DEBUG cinder.utils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Path /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25 not found in is_blk_device check {{(pid=89309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 12:56:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:39 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25 Aug 09 12:56:39 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:44 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:56:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Flow 'volume_create_manager' (0b7c43e6-b420-45af-9d05-8f980436e06a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:56:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4511543-6c38-41c2-917c-fd3ed2742e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4511543-6c38-41c2-917c-fd3ed2742e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e588991-96d6-43c9-80be-0a22a33a5b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f7a9fae61c47df848657188dc828f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:56:44Z,use_quota=True,user_id='fdc58e405fca4ec99d58967565563f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4baf869-957b-4448-bf61-0a4d3fc3549a),volume_type_id=f4baf869-957b-4448-bf61-0a4d3fc3549a)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bea6d4e-3eca-408a-9396-dc53b6b3751b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bea6d4e-3eca-408a-9396-dc53b6b3751b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f483c26-3e26-4781-8c2a-552e7d0eb81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:45 devstack cinder-volume[89309]: DEBUG cinder.image.glance [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Creating Keystone auth plugin from conf {{(pid=89309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 12:56:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f483c26-3e26-4781-8c2a-552e7d0eb81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9e588991-96d6-43c9-80be-0a22a33a5b5c', 'volume_name': 'volume-9e588991-96d6-43c9-80be-0a22a33a5b5c', 'volume_size': 1, 'image_id': 'aedcfa69-4511-4960-92ee-d4f31bfe9faa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aedcfa69-4511-4960-92ee-d4f31bfe9faa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4599b086a6e980a7409090c2db93b498', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e9f7a9fae61c47df848657188dc828f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da3c261ff0b30347d10e52cb3b5d493b99465d25be993b930afdf4853026943cd9f405feb1faf6f9cf8e53abd78cafb8f55d54e2a863f01242117fe9c9a41380', 'id': 'aedcfa69-4511-4960-92ee-d4f31bfe9faa', 'created_at': datetime.datetime(2026, 8, 9, 10, 56, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 56, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aedcfa69-4511-4960-92ee-d4f31bfe9faa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77db19f9-4972-41c9-92cb-1841cc7b55be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77db19f9-4972-41c9-92cb-1841cc7b55be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba152e1-d1e6-4b66-83ee-877a3ddecd2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:46 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Volume 9e588991-96d6-43c9-80be-0a22a33a5b5c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9e588991-96d6-43c9-80be-0a22a33a5b5c', 'volume_size': 1, 'image_id': 'aedcfa69-4511-4960-92ee-d4f31bfe9faa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aedcfa69-4511-4960-92ee-d4f31bfe9faa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4599b086a6e980a7409090c2db93b498', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e9f7a9fae61c47df848657188dc828f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da3c261ff0b30347d10e52cb3b5d493b99465d25be993b930afdf4853026943cd9f405feb1faf6f9cf8e53abd78cafb8f55d54e2a863f01242117fe9c9a41380', 'id': 'aedcfa69-4511-4960-92ee-d4f31bfe9faa', 'created_at': datetime.datetime(2026, 8, 9, 10, 56, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 56, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aedcfa69-4511-4960-92ee-d4f31bfe9faa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 09 12:56:46 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Trying to clone 9e588991-96d6-43c9-80be-0a22a33a5b5c from image aedcfa69-4511-4960-92ee-d4f31bfe9faa at location (None, [{'url': 'file:///opt/stack/data/glance/images/aedcfa69-4511-4960-92ee-d4f31bfe9faa', 'metadata': {}}]). {{(pid=89309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 12:56:46 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 12:56:46 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Image download 0.00 MB at 0.00 MB/s Aug 09 12:56:46 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a39cd0-dd30-47e1-a8ce-bf4c82277bcc]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:47 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD Aug 09 12:56:47 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25" returned: 0 in 8.360s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:47 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa, size 1024.00 MB, duration 8.36 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:56:47 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:47 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Converted 1024.00 MB image at 122.46 MB/s Aug 09 12:56:47 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25 is being set with open permissions: ugo+rw Aug 09 12:56:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:47 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25 Aug 09 12:56:47 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:47 devstack sudo[105599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD Aug 09 12:56:47 devstack sudo[105599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:48 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25" returned: 0 in 0.437s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Lock "cinder-quobyte-f756d9ff-39ad-41e3-b69d-00f74d93df25" released by "_copy_volume_from_snapshot" :: held 10.654s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:48 devstack sudo[105599]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD" returned: 1 in 0.488s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Temporary image aedcfa69-4511-4960-92ee-d4f31bfe9faa is fetched for user fdc58e405fca4ec99d58967565563f57. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Lock "cinder-quobyte-aaf8f8fc-dbf0-4246-922c-6d81bb6632a7-f756d9ff-39ad-41e3-b69d-00f74d93df25" released by "_create_volume_from_snapshot" :: held 10.790s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.825s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a67ac344-dd84-464b-97ac-9b98b8191098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f756d9ff-39ad-41e3-b69d-00f74d93df25', 'volume_size': 1, 'snapshot_id': 'aaf8f8fc-dbf0-4246-922c-6d81bb6632a7'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22bc6dbd-dfa4-42c5-bc7f-26432b9ec472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:48 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Volume volume-f756d9ff-39ad-41e3-b69d-00f74d93df25 (f756d9ff-39ad-41e3-b69d-00f74d93df25): created successfully Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22bc6dbd-dfa4-42c5-bc7f-26432b9ec472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Flow 'volume_create_manager' (7a1b0502-7f28-4c20-865d-9309b13964c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4102f8-3c9c-4b1d-a3ed-d10dcaa32cb2]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d7027078-1d9d-478a-b302-05e7bfa690b6 tempest-TestStampPattern-316392764 None] Created volume successfully. Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:48 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD Aug 09 12:56:48 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:48 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:48 devstack sudo[105610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD Aug 09 12:56:48 devstack sudo[105610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:49 devstack sudo[105610]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:56:43Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e588991-96d6-43c9-80be-0a22a33a5b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e9f7a9fae61c47df848657188dc828f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:56:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:56:44Z,use_quota=True,user_id='fdc58e405fca4ec99d58967565563f57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f4baf869-957b-4448-bf61-0a4d3fc3549a),volume_type_id=f4baf869-957b-4448-bf61-0a4d3fc3549a)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Creating volume 9e588991-96d6-43c9-80be-0a22a33a5b5c {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:56:49 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:49 devstack sudo[105616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c 1073741824 Aug 09 12:56:49 devstack sudo[105616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:49 devstack sudo[105616]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c 1073741824" returned: 0 in 0.769s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:49 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c Aug 09 12:56:49 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:50 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c" returned: 0 in 0.349s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:56:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.198s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:50 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Attempting download of aedcfa69-4511-4960-92ee-d4f31bfe9faa ((None, [{'url': 'file:///opt/stack/data/glance/images/aedcfa69-4511-4960-92ee-d4f31bfe9faa', 'metadata': {}}])) to volume 9e588991-96d6-43c9-80be-0a22a33a5b5c. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 12:56:50 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87ec7d5-3241-4cb5-970e-7c7cc173b083]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aedcfa69-4511-4960-92ee-d4f31bfe9faa_q0xf796s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:50 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aedcfa69-4511-4960-92ee-d4f31bfe9faa_q0xf796s Aug 09 12:56:50 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:50 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aedcfa69-4511-4960-92ee-d4f31bfe9faa_q0xf796s" returned: 0 in 0.508s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aedcfa69-4511-4960-92ee-d4f31bfe9faa_q0xf796s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:51 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aedcfa69-4511-4960-92ee-d4f31bfe9faa_q0xf796s Aug 09 12:56:51 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:51 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aedcfa69-4511-4960-92ee-d4f31bfe9faa_q0xf796s" returned: 1 in 0.630s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aedcfa69-4511-4960-92ee-d4f31bfe9faa_q0xf796s' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:56:51 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2550a48c-6cfe-4866-aab5-086cac08586f]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:51 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD Aug 09 12:56:51 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:52 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD" returned: 0 in 0.579s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:52 devstack sudo[105693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD Aug 09 12:56:52 devstack sudo[105693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:52 devstack sudo[105693]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD" returned: 1 in 0.622s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:56:52 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] aedcfa69-4511-4960-92ee-d4f31bfe9faa was raw, converting to qcow2 {{(pid=89309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 12:56:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:52 devstack sudo[105713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c Aug 09 12:56:52 devstack sudo[105713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:53 devstack sudo[105713]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c" returned: 0 in 0.713s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:53 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aedcfa69-4511-4960-92ee-d4f31bfe9faa_d7hor7gcdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:56:53 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Converted 0.00 MB image at 0.00 MB/s Aug 09 12:56:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:53 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c 1G Aug 09 12:56:53 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:54 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c 1G" returned: 0 in 0.611s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:54 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Downloaded image aedcfa69-4511-4960-92ee-d4f31bfe9faa ((None, [{'url': 'file:///opt/stack/data/glance/images/aedcfa69-4511-4960-92ee-d4f31bfe9faa', 'metadata': {}}])) to volume 9e588991-96d6-43c9-80be-0a22a33a5b5c successfully. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 12:56:54 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Temporary image aedcfa69-4511-4960-92ee-d4f31bfe9faa for user fdc58e405fca4ec99d58967565563f57 is deleted. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 12:56:54 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Marking volume 9e588991-96d6-43c9-80be-0a22a33a5b5c as bootable. {{(pid=89309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 12:56:54 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Copying metadata from image aedcfa69-4511-4960-92ee-d4f31bfe9faa to 9e588991-96d6-43c9-80be-0a22a33a5b5c. {{(pid=89309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 12:56:54 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Creating volume glance metadata for volume 9e588991-96d6-43c9-80be-0a22a33a5b5c backed by image aedcfa69-4511-4960-92ee-d4f31bfe9faa with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'aedcfa69-4511-4960-92ee-d4f31bfe9faa', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '4599b086a6e980a7409090c2db93b498', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 12:56:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ba152e1-d1e6-4b66-83ee-877a3ddecd2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e588991-96d6-43c9-80be-0a22a33a5b5c', 'volume_size': 1, 'image_id': 'aedcfa69-4511-4960-92ee-d4f31bfe9faa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aedcfa69-4511-4960-92ee-d4f31bfe9faa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4599b086a6e980a7409090c2db93b498', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e9f7a9fae61c47df848657188dc828f3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'da3c261ff0b30347d10e52cb3b5d493b99465d25be993b930afdf4853026943cd9f405feb1faf6f9cf8e53abd78cafb8f55d54e2a863f01242117fe9c9a41380', 'id': 'aedcfa69-4511-4960-92ee-d4f31bfe9faa', 'created_at': datetime.datetime(2026, 8, 9, 10, 56, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 56, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aedcfa69-4511-4960-92ee-d4f31bfe9faa/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9540dd-e617-404a-b5c9-50a0f858f351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:56:54 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Volume volume-9e588991-96d6-43c9-80be-0a22a33a5b5c (9e588991-96d6-43c9-80be-0a22a33a5b5c): created successfully Aug 09 12:56:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af9540dd-e617-404a-b5c9-50a0f858f351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:56:54 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Flow 'volume_create_manager' (0b7c43e6-b420-45af-9d05-8f980436e06a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:56:54 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d2af28c7-91ca-44b1-8b9b-38fd284cee36 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Created volume successfully. Aug 09 12:56:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Acquiring lock "cinder-9e588991-96d6-43c9-80be-0a22a33a5b5c-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Lock "cinder-9e588991-96d6-43c9-80be-0a22a33a5b5c-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Acquiring lock "cinder-quobyte-9e588991-96d6-43c9-80be-0a22a33a5b5c" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Lock "cinder-quobyte-9e588991-96d6-43c9-80be-0a22a33a5b5c" acquired by "delete_volume" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:55 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0027189-65f9-46f9-93b3-1905f0fabfa4]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:55 devstack sudo[105750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c Aug 09 12:56:55 devstack sudo[105750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:56 devstack sudo[105750]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c" returned: 0 in 0.512s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:56 devstack sudo[105756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c Aug 09 12:56:56 devstack sudo[105756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:56 devstack sudo[105756]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9e588991-96d6-43c9-80be-0a22a33a5b5c" returned: 0 in 0.473s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Lock "cinder-quobyte-9e588991-96d6-43c9-80be-0a22a33a5b5c" released by "delete_volume" :: held 1.087s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:56 devstack cinder-volume[89309]: WARNING cinder.quota [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:56:56 devstack cinder-volume[89309]: WARNING cinder.quota [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Aug 09 12:56:56 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Created reservations ['47b400b1-f25b-4261-afe6-63c704530100', '783d86c4-4e8b-4bee-b9b9-5c81cbb52b1c', '6688a8b5-d844-482a-a3dd-607624e8b181', '492be96f-8e2b-4869-87e4-325772cd6dac'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:56:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:56:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:56:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:56 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:56:56 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:57 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.376s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:57 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:56:57 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Deleted volume successfully. Aug 09 12:56:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4e569b73-a1a9-4b1a-9ed1-a13e1aac6138 tempest-VolumeAndVolumeTypeFromImageTest-835691002 None] Lock "cinder-9e588991-96d6-43c9-80be-0a22a33a5b5c-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:56:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:56:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:56:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:56:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:56:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:56:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:56:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:57 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:56:57 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:56:58 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Aug 09 12:56:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.642s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:56:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:56:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:56:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:56:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:56:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Acquiring lock "cinder-d112ff8c-3b08-4bf0-b542-d4b924bd9842-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Lock "cinder-d112ff8c-3b08-4bf0-b542-d4b924bd9842-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Acquiring lock "cinder-quobyte-d112ff8c-3b08-4bf0-b542-d4b924bd9842" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:56:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Lock "cinder-quobyte-d112ff8c-3b08-4bf0-b542-d4b924bd9842" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:56:59 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7de0c5-87ad-4607-86db-f87902bd315a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:56:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:56:59 devstack sudo[105767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842 Aug 09 12:56:59 devstack sudo[105767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:00 devstack sudo[105767]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842" returned: 0 in 0.618s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:00 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842 Aug 09 12:57:00 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:00 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d112ff8c-3b08-4bf0-b542-d4b924bd9842" returned: 0 in 0.315s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Lock "cinder-quobyte-d112ff8c-3b08-4bf0-b542-d4b924bd9842" released by "delete_volume" :: held 0.995s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:00 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Created reservations ['24a4d453-08ee-40a8-aaea-ef5080a23940', '6551a349-0828-4c37-ae67-174be0f7534e', 'a07dc156-2b32-4a64-b8ad-6898a09b1b80', 'a98f17f0-8f04-48e0-ba53-e2923a5b0fed'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:01 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:01 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:01 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.290s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:01 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:01 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Deleted volume successfully. Aug 09 12:57:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-06a1e3a9-9b97-4d7d-9ff2-d7a20af97eea tempest-VolumesNegativeTest-517560387 None] Lock "cinder-d112ff8c-3b08-4bf0-b542-d4b924bd9842-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:05 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:57:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Flow 'volume_create_manager' (bac29d4f-dba6-412e-b93b-16ffd1357917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971d7ec6-9391-4434-a3c5-ab5a0685f58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (971d7ec6-9391-4434-a3c5-ab5a0685f58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1211098516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0496c607-bd04-495c-a002-051c9d2fc6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7adfabb92e546e1b832bec6aaa1a08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:06Z,use_quota=True,user_id='31abd6f42a684a038027867909a5288b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff59ea1-5331-4146-a6e9-c77773afbc9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff59ea1-5331-4146-a6e9-c77773afbc9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6f660c-137b-4242-900d-b7e9a82b980a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af6f660c-137b-4242-900d-b7e9a82b980a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0496c607-bd04-495c-a002-051c9d2fc6bb', 'volume_name': 'volume-0496c607-bd04-495c-a002-051c9d2fc6bb', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4abcedd-3e81-4da2-b890-7feeea8820c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4abcedd-3e81-4da2-b890-7feeea8820c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232cea0a-6929-4698-82e6-33c0162be97a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:06 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Volume 0496c607-bd04-495c-a002-051c9d2fc6bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0496c607-bd04-495c-a002-051c9d2fc6bb', 'volume_size': 1} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1211098516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0496c607-bd04-495c-a002-051c9d2fc6bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7adfabb92e546e1b832bec6aaa1a08a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:06Z,use_quota=True,user_id='31abd6f42a684a038027867909a5288b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Creating volume 0496c607-bd04-495c-a002-051c9d2fc6bb {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:57:06 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:06 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb 1073741824 Aug 09 12:57:06 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:06 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb 1073741824" returned: 0 in 0.762s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=80,cinder:UPDATE=68,cinder:INSERT=17,cinder:DELETE=4 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=73,cinder:UPDATE=85,cinder:DELETE=8,cinder:INSERT=26 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:57:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:06 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb Aug 09 12:57:06 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:07 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb" returned: 0 in 0.282s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:57:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (232cea0a-6929-4698-82e6-33c0162be97a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0496c607-bd04-495c-a002-051c9d2fc6bb', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c4ec1c-9fd9-48b6-b68e-e4f5c8caed1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:07 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Volume volume-0496c607-bd04-495c-a002-051c9d2fc6bb (0496c607-bd04-495c-a002-051c9d2fc6bb): created successfully Aug 09 12:57:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28c4ec1c-9fd9-48b6-b68e-e4f5c8caed1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:07 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Flow 'volume_create_manager' (bac29d4f-dba6-412e-b93b-16ffd1357917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:07 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-43c7aaa2-1635-4ffd-9529-0a33cc7a7eef tempest-VolumesSnapshotListTestJSON-1920890598 None] Created volume successfully. Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] Creating offline snapshot e091721a-792b-4150-81c4-94a116a2f5b8 of volume 0496c607-bd04-495c-a002-051c9d2fc6bb {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[03e63bd8-5a20-4b7b-ac7e-a79596ce4f55]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:08 devstack sudo[105804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb Aug 09 12:57:08 devstack sudo[105804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Flow 'volume_create_manager' (f15f4415-819b-49b3-9221-ac16dbe87521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1466817a-8bc8-46cf-a6f0-5ad1ce87d92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:08 devstack sudo[105804]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1466817a-8bc8-46cf-a6f0-5ad1ce87d92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111749e7-232d-4a26-bddc-d920e87515a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a0ae86bd7e4ec097e5ea3ade101e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:09Z,use_quota=True,user_id='4c4530c70c1c43f692eddc5878514238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e4b8e6-e044-4afc-804c-f2a9ad7b5b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84e4b8e6-e044-4afc-804c-f2a9ad7b5b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32554be-e47e-4deb-8906-6067b3f1fdc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG cinder.image.glance [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Creating Keystone auth plugin from conf {{(pid=89309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb" returned: 0 in 0.465s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:08 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 1G Aug 09 12:57:08 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f32554be-e47e-4deb-8906-6067b3f1fdc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '111749e7-232d-4a26-bddc-d920e87515a1', 'volume_name': 'volume-111749e7-232d-4a26-bddc-d920e87515a1', 'volume_size': 1, 'image_id': 'e22469e6-9e4b-4bd4-afe7-a6aedf2137aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e22469e6-9e4b-4bd4-afe7-a6aedf2137aa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16681be155c0826955805e86ec0d2d4b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e1a0ae86bd7e4ec097e5ea3ade101e4b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05f659f7b3bba0a0233e7b10f3a05f41d77f146612fa3f37ff32eef111e474d30cdfff61e1264e8685a6a96099c06f184f3b22ab629187e25c57b77e6d6f9f31', 'id': 'e22469e6-9e4b-4bd4-afe7-a6aedf2137aa', 'created_at': datetime.datetime(2026, 8, 9, 10, 57, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 57, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e22469e6-9e4b-4bd4-afe7-a6aedf2137aa/file', 'properties': {}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19fa6677-405c-4961-9576-500741029ff1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19fa6677-405c-4961-9576-500741029ff1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1741ee-283e-440b-b5c0-fff026141aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:09 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Volume 111749e7-232d-4a26-bddc-d920e87515a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-111749e7-232d-4a26-bddc-d920e87515a1', 'volume_size': 1, 'image_id': 'e22469e6-9e4b-4bd4-afe7-a6aedf2137aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e22469e6-9e4b-4bd4-afe7-a6aedf2137aa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16681be155c0826955805e86ec0d2d4b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e1a0ae86bd7e4ec097e5ea3ade101e4b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05f659f7b3bba0a0233e7b10f3a05f41d77f146612fa3f37ff32eef111e474d30cdfff61e1264e8685a6a96099c06f184f3b22ab629187e25c57b77e6d6f9f31', 'id': 'e22469e6-9e4b-4bd4-afe7-a6aedf2137aa', 'created_at': datetime.datetime(2026, 8, 9, 10, 57, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 57, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e22469e6-9e4b-4bd4-afe7-a6aedf2137aa/file', 'properties': {}}, 'image_service': } Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Trying to clone 111749e7-232d-4a26-bddc-d920e87515a1 from image e22469e6-9e4b-4bd4-afe7-a6aedf2137aa at location (None, [{'url': 'file:///opt/stack/data/glance/images/e22469e6-9e4b-4bd4-afe7-a6aedf2137aa', 'metadata': {}}]). {{(pid=89309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 12:57:09 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Image download 0.00 MB at 0.00 MB/s Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6533862b-b277-4245-af7c-521762685df8]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:09 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 1G" returned: 0 in 0.607s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0496c607-bd04-495c-a002-051c9d2fc6bb -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:09 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0496c607-bd04-495c-a002-051c9d2fc6bb -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 Aug 09 12:57:09 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:09 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD Aug 09 12:57:09 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:09 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:09 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0496c607-bd04-495c-a002-051c9d2fc6bb -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8" returned: 0 in 0.414s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:09 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 is being set with open permissions: ugo+rw Aug 09 12:57:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:09 devstack sudo[105826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 Aug 09 12:57:09 devstack sudo[105826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:09 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD Aug 09 12:57:09 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:10 devstack sudo[105826]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:10 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8" returned: 0 in 0.256s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD" returned: 1 in 0.343s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Temporary image e22469e6-9e4b-4bd4-afe7-a6aedf2137aa is fetched for user 4c4530c70c1c43f692eddc5878514238. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:10 devstack sudo[105833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.info Aug 09 12:57:10 devstack sudo[105833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bff8c55-b91c-450c-9253-221dece24dd5]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:10 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD Aug 09 12:57:10 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:10 devstack sudo[105833]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.info" returned: 0 in 0.294s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:10 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.info is being set with open permissions: ugo+rw Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:10 devstack sudo[105839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.info Aug 09 12:57:10 devstack sudo[105839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:10 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD" returned: 0 in 0.403s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:10 devstack sudo[105839]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.info" returned: 0 in 0.252s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.402s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:10 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD Aug 09 12:57:10 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:10 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-98fdb30a-e2cd-440b-bfb0-36eac5bb090f tempest-VolumesSnapshotListTestJSON-1920890598 None] Create snapshot completed successfully Aug 09 12:57:10 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD" returned: 1 in 0.384s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=111749e7-232d-4a26-bddc-d920e87515a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e1a0ae86bd7e4ec097e5ea3ade101e4b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:09Z,use_quota=True,user_id='4c4530c70c1c43f692eddc5878514238',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Creating volume 111749e7-232d-4a26-bddc-d920e87515a1 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:57:10 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:57:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:10 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 1073741824 Aug 09 12:57:10 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:11 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 1073741824" returned: 0 in 0.501s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:11 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 Aug 09 12:57:11 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:11 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1" returned: 0 in 0.306s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:57:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.104s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] Creating offline snapshot e4b00945-e3f5-4b4f-85ef-24cb0649653f of volume 0496c607-bd04-495c-a002-051c9d2fc6bb {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:57:11 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Attempting download of e22469e6-9e4b-4bd4-afe7-a6aedf2137aa ((None, [{'url': 'file:///opt/stack/data/glance/images/e22469e6-9e4b-4bd4-afe7-a6aedf2137aa', 'metadata': {}}])) to volume 111749e7-232d-4a26-bddc-d920e87515a1. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 12:57:11 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5760568b-cfd1-4ddf-a324-53c9050a6abf]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:11 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2618b4ae-3cdc-40f2-8f49-6cb398b8be62]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_18jb7p0r {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:11 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 Aug 09 12:57:11 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:12 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_18jb7p0r Aug 09 12:57:12 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:12 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8" returned: 0 in 0.414s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0496c607-bd04-495c-a002-051c9d2fc6bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:57:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:12 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_18jb7p0r" returned: 0 in 0.369s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_18jb7p0r {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:12 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f 1G Aug 09 12:57:12 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:12 devstack sudo[105870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_18jb7p0r Aug 09 12:57:12 devstack sudo[105870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:12 devstack sudo[105870]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_18jb7p0r" returned: 1 in 0.474s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_18jb7p0r' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:57:12 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bb406b-5658-4921-9659-0669c5796ddf]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:12 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f 1G" returned: 0 in 0.586s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:12 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f Aug 09 12:57:12 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:12 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD Aug 09 12:57:12 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:13 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD" returned: 0 in 0.383s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:13 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f" returned: 0 in 0.354s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:13 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f is being set with open permissions: ugo+rw Aug 09 12:57:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:13 devstack sudo[105890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f Aug 09 12:57:13 devstack sudo[105890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:13 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD Aug 09 12:57:13 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:13 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD" returned: 1 in 0.341s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:57:13 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] e22469e6-9e4b-4bd4-afe7-a6aedf2137aa was raw, converting to qcow2 {{(pid=89309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 12:57:13 devstack sudo[105890]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f" returned: 0 in 0.295s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:13 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 Aug 09 12:57:13 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.776s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:13 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-04d00486-e3b8-4235-a0d4-af4e4afeb124 tempest-VolumesSnapshotListTestJSON-1920890598 None] Create snapshot completed successfully Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] Creating offline snapshot b294b671-23ec-487b-a3c0-2b8aa7246688 of volume 0496c607-bd04-495c-a002-051c9d2fc6bb {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad2d759-e02c-4688-83c1-d2f0cb42c164]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:14 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1" returned: 0 in 0.639s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e22469e6-9e4b-4bd4-afe7-a6aedf2137aa_k3u9bss_devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:57:14 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Converted 0.00 MB image at 0.00 MB/s Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:14 devstack sudo[105904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 1G Aug 09 12:57:14 devstack sudo[105904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:14 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f Aug 09 12:57:14 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:14 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f" returned: 0 in 0.520s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0496c607-bd04-495c-a002-051c9d2fc6bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:14 devstack sudo[105904]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 1G" returned: 0 in 0.498s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Downloaded image e22469e6-9e4b-4bd4-afe7-a6aedf2137aa ((None, [{'url': 'file:///opt/stack/data/glance/images/e22469e6-9e4b-4bd4-afe7-a6aedf2137aa', 'metadata': {}}])) to volume 111749e7-232d-4a26-bddc-d920e87515a1 successfully. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Temporary image e22469e6-9e4b-4bd4-afe7-a6aedf2137aa for user 4c4530c70c1c43f692eddc5878514238 is deleted. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Marking volume 111749e7-232d-4a26-bddc-d920e87515a1 as bootable. {{(pid=89309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Copying metadata from image e22469e6-9e4b-4bd4-afe7-a6aedf2137aa to 111749e7-232d-4a26-bddc-d920e87515a1. {{(pid=89309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Creating volume glance metadata for volume 111749e7-232d-4a26-bddc-d920e87515a1 backed by image e22469e6-9e4b-4bd4-afe7-a6aedf2137aa with: {'image_id': 'e22469e6-9e4b-4bd4-afe7-a6aedf2137aa', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '16681be155c0826955805e86ec0d2d4b', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 12:57:14 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 1G Aug 09 12:57:14 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1741ee-283e-440b-b5c0-fff026141aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-111749e7-232d-4a26-bddc-d920e87515a1', 'volume_size': 1, 'image_id': 'e22469e6-9e4b-4bd4-afe7-a6aedf2137aa', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e22469e6-9e4b-4bd4-afe7-a6aedf2137aa', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '16681be155c0826955805e86ec0d2d4b', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e1a0ae86bd7e4ec097e5ea3ade101e4b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '05f659f7b3bba0a0233e7b10f3a05f41d77f146612fa3f37ff32eef111e474d30cdfff61e1264e8685a6a96099c06f184f3b22ab629187e25c57b77e6d6f9f31', 'id': 'e22469e6-9e4b-4bd4-afe7-a6aedf2137aa', 'created_at': datetime.datetime(2026, 8, 9, 10, 57, 6, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 57, 8, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e22469e6-9e4b-4bd4-afe7-a6aedf2137aa/file', 'properties': {}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8ce536-d6e4-4b18-9abb-e22f245ebb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:14 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Volume volume-111749e7-232d-4a26-bddc-d920e87515a1 (111749e7-232d-4a26-bddc-d920e87515a1): created successfully Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe8ce536-d6e4-4b18-9abb-e22f245ebb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Flow 'volume_create_manager' (f15f4415-819b-49b3-9221-ac16dbe87521) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:14 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2078a577-d52a-4276-94bd-db91b5439ed1 tempest-VolumeImageDependencyTests-1776060392 None] Created volume successfully. Aug 09 12:57:15 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 1G" returned: 0 in 0.608s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Acquiring lock "cinder-111749e7-232d-4a26-bddc-d920e87515a1-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:15 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 Aug 09 12:57:15 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Lock "cinder-111749e7-232d-4a26-bddc-d920e87515a1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Acquiring lock "cinder-quobyte-111749e7-232d-4a26-bddc-d920e87515a1" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Lock "cinder-quobyte-111749e7-232d-4a26-bddc-d920e87515a1" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cb9b9a4-b3df-42ea-a151-95eafd4e54c5]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:15 devstack sudo[105924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 Aug 09 12:57:15 devstack sudo[105924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:15 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688" returned: 0 in 0.393s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:15 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 is being set with open permissions: ugo+rw Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:15 devstack sudo[105929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 Aug 09 12:57:15 devstack sudo[105929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:15 devstack sudo[105924]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1" returned: 0 in 0.447s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:15 devstack sudo[105934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1 Aug 09 12:57:15 devstack sudo[105934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:15 devstack sudo[105929]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688" returned: 0 in 0.290s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.924s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-3f55cfa6-ee52-4b5a-92d7-d409f56ab63a tempest-VolumesSnapshotListTestJSON-1920890598 None] Create snapshot completed successfully Aug 09 12:57:16 devstack sudo[105934]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-111749e7-232d-4a26-bddc-d920e87515a1" returned: 0 in 0.306s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Lock "cinder-quobyte-111749e7-232d-4a26-bddc-d920e87515a1" released by "delete_volume" :: held 0.818s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:16 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Created reservations ['e34772f2-d9e5-4864-93fd-3246d3e5a415', 'f88703f6-bc97-4711-89d0-2c067a8d4e33', '3f5d6ace-1ef0-4e66-9a0b-79f34b895e88', '1199c03e-7bff-4d84-ab79-7af12a7d786f'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:16 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:16 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:16 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.369s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:16 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Deleted volume successfully. Aug 09 12:57:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ea2b56e6-07da-4a38-a4cb-ce5d45081b1a tempest-VolumeImageDependencyTests-1776060392 None] Lock "cinder-111749e7-232d-4a26-bddc-d920e87515a1-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "cinder-b294b671-23ec-487b-a3c0-2b8aa7246688-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-b294b671-23ec-487b-a3c0-2b8aa7246688-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "cinder-quobyte-0496c607-bd04-495c-a002-051c9d2fc6bb" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-0496c607-bd04-495c-a002-051c9d2fc6bb" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "cinder-quobyte-b294b671-23ec-487b-a3c0-2b8aa7246688" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-b294b671-23ec-487b-a3c0-2b8aa7246688" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Deleting offline snapshot b294b671-23ec-487b-a3c0-2b8aa7246688 of volume 0496c607-bd04-495c-a002-051c9d2fc6bb {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] snapshot_file for this snap is: volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bb0679-1229-4899-bfa7-02f700efe5db]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:17 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 Aug 09 12:57:17 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:17 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688" returned: 0 in 0.528s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0496c607-bd04-495c-a002-051c9d2fc6bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[33519741-a086-4ab2-987b-d95bd6f52a5a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:17 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f Aug 09 12:57:17 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:18 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f" returned: 0 in 0.470s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0496c607-bd04-495c-a002-051c9d2fc6bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:57:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:18 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 Aug 09 12:57:18 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:18 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688" returned: 0 in 0.601s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:18 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688 Aug 09 12:57:18 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:19 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.b294b671-23ec-487b-a3c0-2b8aa7246688" returned: 0 in 0.329s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-b294b671-23ec-487b-a3c0-2b8aa7246688" released by "_delete_snapshot" :: held 2.076s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-0496c607-bd04-495c-a002-051c9d2fc6bb" released by "delete_snapshot" :: held 2.104s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:19 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Created reservations ['e214dbd1-9f33-43d6-9865-9f57fb87a482', '1522662b-f1a4-4818-b458-ce199c098b3c', 'e98f83ff-b192-469c-980d-8695e9d13b25', 'e7b15029-f2fc-4e21-90c2-b983c9e75bce'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:19 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Delete snapshot completed successfully. Aug 09 12:57:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d0d4337-62fa-4298-b343-bea0cbc5077c tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-b294b671-23ec-487b-a3c0-2b8aa7246688-delete_snapshot" released by "delete_snapshot" :: held 2.334s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "cinder-e4b00945-e3f5-4b4f-85ef-24cb0649653f-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-e4b00945-e3f5-4b4f-85ef-24cb0649653f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "cinder-quobyte-0496c607-bd04-495c-a002-051c9d2fc6bb" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-0496c607-bd04-495c-a002-051c9d2fc6bb" acquired by "delete_snapshot" :: waited 0.034s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "cinder-quobyte-e4b00945-e3f5-4b4f-85ef-24cb0649653f" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-e4b00945-e3f5-4b4f-85ef-24cb0649653f" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Deleting offline snapshot e4b00945-e3f5-4b4f-85ef-24cb0649653f of volume 0496c607-bd04-495c-a002-051c9d2fc6bb {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] snapshot_file for this snap is: volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe6cbda-4f38-41ee-9a6a-2acb0ae50918]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:20 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:57:20 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Flow 'volume_create_manager' (a85844ff-0d14-4b83-8e30-b92e8b0bee7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02560a22-5cd7-4ead-8092-0a397b8c5d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02560a22-5cd7-4ead-8092-0a397b8c5d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75d5b0a-d857-4f40-973e-9461d2f09f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4755597e324f87ba77bb4386cf914f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:21Z,use_quota=True,user_id='c0f6e6cc8da941d6b044fa6e5ebfb607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c651112-627d-48a0-874b-b926b3f64158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c651112-627d-48a0-874b-b926b3f64158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e183c04b-610c-4359-8462-4c74a73e8be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e183c04b-610c-4359-8462-4c74a73e8be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f75d5b0a-d857-4f40-973e-9461d2f09f61', 'volume_name': 'volume-f75d5b0a-d857-4f40-973e-9461d2f09f61', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7ab45c-852a-483b-91f5-27197e18006c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7ab45c-852a-483b-91f5-27197e18006c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259043dd-df5a-436e-8b3c-421358d4c4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:20 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Volume f75d5b0a-d857-4f40-973e-9461d2f09f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f75d5b0a-d857-4f40-973e-9461d2f09f61', 'volume_size': 1} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f75d5b0a-d857-4f40-973e-9461d2f09f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4755597e324f87ba77bb4386cf914f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:21Z,use_quota=True,user_id='c0f6e6cc8da941d6b044fa6e5ebfb607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Creating volume f75d5b0a-d857-4f40-973e-9461d2f09f61 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:57:20 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:57:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f75d5b0a-d857-4f40-973e-9461d2f09f61 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:20 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f75d5b0a-d857-4f40-973e-9461d2f09f61 1073741824 Aug 09 12:57:20 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:21 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f" returned: 0 in 0.578s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0496c607-bd04-495c-a002-051c9d2fc6bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-9796752c-9518-418b-94ea-47b9fadcdfe0 req-d5d09687-8465-412a-b884-f8cc933864d5 tempest-TestStampPattern-316392764 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[45cce00c-b45e-4004-8687-517323277c89]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:21 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 Aug 09 12:57:21 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:21 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f75d5b0a-d857-4f40-973e-9461d2f09f61 1073741824" returned: 0 in 0.565s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f75d5b0a-d857-4f40-973e-9461d2f09f61 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:21 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f75d5b0a-d857-4f40-973e-9461d2f09f61 Aug 09 12:57:21 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:21 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8" returned: 0 in 0.405s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0496c607-bd04-495c-a002-051c9d2fc6bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:21 devstack sudo[105994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f Aug 09 12:57:21 devstack sudo[105994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:21 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f75d5b0a-d857-4f40-973e-9461d2f09f61" returned: 0 in 0.270s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-9796752c-9518-418b-94ea-47b9fadcdfe0 req-d5d09687-8465-412a-b884-f8cc933864d5 tempest-TestStampPattern-316392764 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.612s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (259043dd-df5a-436e-8b3c-421358d4c4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f75d5b0a-d857-4f40-973e-9461d2f09f61', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5396b5bf-fd11-4679-9a12-f47ff9c4e6d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-9796752c-9518-418b-94ea-47b9fadcdfe0 req-d5d09687-8465-412a-b884-f8cc933864d5 tempest-TestStampPattern-316392764 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.094s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:21 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Volume volume-f75d5b0a-d857-4f40-973e-9461d2f09f61 (f75d5b0a-d857-4f40-973e-9461d2f09f61): created successfully Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5396b5bf-fd11-4679-9a12-f47ff9c4e6d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:21 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Flow 'volume_create_manager' (a85844ff-0d14-4b83-8e30-b92e8b0bee7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a19da7e9-bf09-4bbd-a07b-10e884e196b4 tempest-CinderUnicodeTest-1025713832 None] Created volume successfully. Aug 09 12:57:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-9796752c-9518-418b-94ea-47b9fadcdfe0 req-d5d09687-8465-412a-b884-f8cc933864d5 tempest-TestStampPattern-316392764 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-f756d9ff-39ad-41e3-b69d-00f74d93df25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd7e4a90c-31eb-4cea-af69-f497ece046e8', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:57:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-9796752c-9518-418b-94ea-47b9fadcdfe0 req-d5d09687-8465-412a-b884-f8cc933864d5 tempest-TestStampPattern-316392764 None] attachment_update completed successfully. Aug 09 12:57:22 devstack sudo[105994]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f" returned: 0 in 0.553s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:22 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f Aug 09 12:57:22 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:22 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e4b00945-e3f5-4b4f-85ef-24cb0649653f" returned: 0 in 0.348s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-e4b00945-e3f5-4b4f-85ef-24cb0649653f" released by "_delete_snapshot" :: held 2.050s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-0496c607-bd04-495c-a002-051c9d2fc6bb" released by "delete_snapshot" :: held 2.091s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:22 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Created reservations ['2dc36e1a-0c98-4b6d-b374-4da17fe993c1', '20cba290-ab05-4ac9-b757-b324faca257e', '21633ae8-798a-4055-8b48-76460c529a41', '4adcf6fb-48ef-4298-906b-baa4ab93fabd'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Delete snapshot completed successfully. Aug 09 12:57:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4c945a3c-13ec-4062-adae-176f561fd236 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-e4b00945-e3f5-4b4f-85ef-24cb0649653f-delete_snapshot" released by "delete_snapshot" :: held 2.301s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Flow 'volume_create_manager' (99cd85a3-80a7-41e8-9d42-3e9a1c996f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146e3c48-4cd6-4422-81e9-de71450cb10a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "cinder-e091721a-792b-4150-81c4-94a116a2f5b8-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (146e3c48-4cd6-4422-81e9-de71450cb10a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-578772402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe4c395-57d8-43bc-b999-234e335eee10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4755597e324f87ba77bb4386cf914f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:24Z,use_quota=True,user_id='c0f6e6cc8da941d6b044fa6e5ebfb607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561f6c16-4376-4b95-8b06-a7e555609611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561f6c16-4376-4b95-8b06-a7e555609611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3db0eaf-5fcb-4fe6-a190-82da1f7da61a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3db0eaf-5fcb-4fe6-a190-82da1f7da61a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebe4c395-57d8-43bc-b999-234e335eee10', 'volume_name': 'volume-ebe4c395-57d8-43bc-b999-234e335eee10', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6bd5a2-6b38-41f5-b5da-7f046a147aa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6bd5a2-6b38-41f5-b5da-7f046a147aa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4576d214-900e-4916-a44d-a750a6a82218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:23 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Volume ebe4c395-57d8-43bc-b999-234e335eee10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebe4c395-57d8-43bc-b999-234e335eee10', 'volume_size': 1} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-578772402',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebe4c395-57d8-43bc-b999-234e335eee10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de4755597e324f87ba77bb4386cf914f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:24Z,use_quota=True,user_id='c0f6e6cc8da941d6b044fa6e5ebfb607',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Creating volume ebe4c395-57d8-43bc-b999-234e335eee10 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:57:23 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-e091721a-792b-4150-81c4-94a116a2f5b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.163s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "cinder-quobyte-0496c607-bd04-495c-a002-051c9d2fc6bb" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:23 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10 1073741824 Aug 09 12:57:23 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-0496c607-bd04-495c-a002-051c9d2fc6bb" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "cinder-quobyte-e091721a-792b-4150-81c4-94a116a2f5b8" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-e091721a-792b-4150-81c4-94a116a2f5b8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Deleting offline snapshot e091721a-792b-4150-81c4-94a116a2f5b8 of volume 0496c607-bd04-495c-a002-051c9d2fc6bb {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] snapshot_file for this snap is: volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3315bb8d-a8fa-4d2b-8f24-cfa40ee71d54]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:24 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 Aug 09 12:57:24 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:24 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8" returned: 0 in 0.600s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0496c607-bd04-495c-a002-051c9d2fc6bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:57:24 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10 1073741824" returned: 0 in 0.764s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:24 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad47c0eb-4f31-4adb-b4d9-67172bee5f1a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:24 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10 Aug 09 12:57:24 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:24 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb Aug 09 12:57:24 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:25 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10" returned: 0 in 0.404s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:57:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4576d214-900e-4916-a44d-a750a6a82218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebe4c395-57d8-43bc-b999-234e335eee10', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ef606e-8b03-4667-866d-3cbc0c1b062d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:25 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Volume volume-ebe4c395-57d8-43bc-b999-234e335eee10 (ebe4c395-57d8-43bc-b999-234e335eee10): created successfully Aug 09 12:57:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (71ef606e-8b03-4667-866d-3cbc0c1b062d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Flow 'volume_create_manager' (99cd85a3-80a7-41e8-9d42-3e9a1c996f8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:25 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb" returned: 0 in 0.535s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:25 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e5ea4a59-8676-433a-8395-69aa07e2d04e tempest-CinderUnicodeTest-1025713832 None] Created volume successfully. Aug 09 12:57:25 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 Aug 09 12:57:25 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:25 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8" returned: 0 in 0.542s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:25 devstack sudo[106431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8 Aug 09 12:57:25 devstack sudo[106431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:26 devstack sudo[106431]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] Creating offline snapshot 68892680-ea83-411f-a533-a9ce6ebfd0ac of volume ebe4c395-57d8-43bc-b999-234e335eee10 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:57:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb.e091721a-792b-4150-81c4-94a116a2f5b8" returned: 0 in 0.385s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:26 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4d809f-9e83-4eff-8044-ab6c3b22802c]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-e091721a-792b-4150-81c4-94a116a2f5b8" released by "_delete_snapshot" :: held 2.249s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-0496c607-bd04-495c-a002-051c9d2fc6bb" released by "delete_snapshot" :: held 2.280s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:26 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Created reservations ['40a7fdcd-94ff-4f57-8ce0-117032055268', '8bd9c9f1-a021-4a0f-adf1-c86ff0c7d5ea', 'c5866bde-339d-4c2f-a1c4-4c41c358d53d', '235753ee-2957-486a-b2d2-ea68541645b2'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:26 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10 Aug 09 12:57:26 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:26 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-d88af152-715d-4cab-ac77-8e9dee484abd req-3caaeb95-31ae-468b-90a8-8ce5c5766dcb tempest-TestStampPattern-316392764 None] Terminate volume connection completed successfully. Aug 09 12:57:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-d88af152-715d-4cab-ac77-8e9dee484abd req-3caaeb95-31ae-468b-90a8-8ce5c5766dcb tempest-TestStampPattern-316392764 None] Deleting attachment d7e4a90c-31eb-4cea-af69-f497ece046e8. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:57:26 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Delete snapshot completed successfully. Aug 09 12:57:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c17ed09-e8ec-4933-9bb3-a099ddb9affa tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-e091721a-792b-4150-81c4-94a116a2f5b8-delete_snapshot" released by "delete_snapshot" :: held 2.526s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:26 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10" returned: 0 in 0.500s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:26 devstack sudo[106469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac 1G Aug 09 12:57:26 devstack sudo[106469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "cinder-0496c607-bd04-495c-a002-051c9d2fc6bb-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-0496c607-bd04-495c-a002-051c9d2fc6bb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "cinder-quobyte-0496c607-bd04-495c-a002-051c9d2fc6bb" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-0496c607-bd04-495c-a002-051c9d2fc6bb" acquired by "delete_volume" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:27 devstack sudo[106469]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac 1G" returned: 0 in 0.652s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe4c395-57d8-43bc-b999-234e335eee10 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:27 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa6b298-092a-44d7-a9c0-d5ba0366c8d5]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:27 devstack sudo[106476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe4c395-57d8-43bc-b999-234e335eee10 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac Aug 09 12:57:27 devstack sudo[106476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:27 devstack sudo[106477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb Aug 09 12:57:27 devstack sudo[106477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:27 devstack sudo[106476]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebe4c395-57d8-43bc-b999-234e335eee10 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac" returned: 0 in 0.423s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:27 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac is being set with open permissions: ugo+rw Aug 09 12:57:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:27 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac Aug 09 12:57:27 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:27 devstack sudo[106477]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb" returned: 0 in 0.600s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:28 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb Aug 09 12:57:28 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:28 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac" returned: 0 in 0.517s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:28 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.info Aug 09 12:57:28 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:28 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0496c607-bd04-495c-a002-051c9d2fc6bb" returned: 0 in 0.516s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-quobyte-0496c607-bd04-495c-a002-051c9d2fc6bb" released by "delete_volume" :: held 1.215s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:28 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Created reservations ['a3c09fd1-6ff8-453b-9162-6df93c5616a5', 'bcb31b14-02a8-4297-b65c-595deaf11f7d', 'f099bbcb-92bf-4415-9a18-790c791c7b5d', '4395e1f9-4b9b-4dcd-8ae8-7cac5d6a704c'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:28 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:28 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:28 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.info" returned: 0 in 0.610s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:28 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.info is being set with open permissions: ugo+rw Aug 09 12:57:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:29 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.info Aug 09 12:57:29 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:29 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.458s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:29 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:29 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Deleted volume successfully. Aug 09 12:57:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b0395cff-1051-43c4-98cb-477cf11fdcb1 tempest-VolumesSnapshotListTestJSON-1920890598 None] Lock "cinder-0496c607-bd04-495c-a002-051c9d2fc6bb-delete_volume" released by "delete_volume" :: held 2.018s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:29 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.info" returned: 0 in 0.423s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.317s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:29 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a3c30ef6-7549-45f1-a96e-1cdcbf3bb355 tempest-CinderUnicodeTest-1025713832 None] Create snapshot completed successfully Aug 09 12:57:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "cinder-68892680-ea83-411f-a533-a9ce6ebfd0ac-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-68892680-ea83-411f-a533-a9ce6ebfd0ac-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "cinder-quobyte-ebe4c395-57d8-43bc-b999-234e335eee10" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-quobyte-ebe4c395-57d8-43bc-b999-234e335eee10" acquired by "delete_snapshot" :: waited 0.039s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "cinder-quobyte-68892680-ea83-411f-a533-a9ce6ebfd0ac" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-quobyte-68892680-ea83-411f-a533-a9ce6ebfd0ac" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Deleting offline snapshot 68892680-ea83-411f-a533-a9ce6ebfd0ac of volume ebe4c395-57d8-43bc-b999-234e335eee10 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:57:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] snapshot_file for this snap is: volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:57:30 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a70558-6391-4faa-b937-667ccb734693]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:30 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac Aug 09 12:57:30 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:31 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac" returned: 0 in 0.544s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebe4c395-57d8-43bc-b999-234e335eee10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:57:31 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb63bdf-38e6-4b2a-9e28-718810726a75]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:31 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10 Aug 09 12:57:31 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Acquiring lock "cinder-f756d9ff-39ad-41e3-b69d-00f74d93df25-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Lock "cinder-f756d9ff-39ad-41e3-b69d-00f74d93df25-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Acquiring lock "cinder-quobyte-f756d9ff-39ad-41e3-b69d-00f74d93df25" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Lock "cinder-quobyte-f756d9ff-39ad-41e3-b69d-00f74d93df25" acquired by "delete_volume" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:31 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3c8d3d-239a-4b7c-8f52-3524911eaa4a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:31 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10" returned: 0 in 0.567s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:31 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac Aug 09 12:57:31 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:31 devstack sudo[106544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25 Aug 09 12:57:31 devstack sudo[106544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:32 devstack sudo[106544]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25" returned: 0 in 0.490s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:32 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac" returned: 0 in 0.474s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:32 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25 Aug 09 12:57:32 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:32 devstack sudo[106556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac Aug 09 12:57:32 devstack sudo[106556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:32 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f756d9ff-39ad-41e3-b69d-00f74d93df25" returned: 0 in 0.293s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Lock "cinder-quobyte-f756d9ff-39ad-41e3-b69d-00f74d93df25" released by "delete_volume" :: held 0.843s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:32 devstack sudo[106556]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10.68892680-ea83-411f-a533-a9ce6ebfd0ac" returned: 0 in 0.329s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-quobyte-68892680-ea83-411f-a533-a9ce6ebfd0ac" released by "_delete_snapshot" :: held 2.069s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-quobyte-ebe4c395-57d8-43bc-b999-234e335eee10" released by "delete_snapshot" :: held 2.099s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Created reservations ['c105b029-23b1-4a1f-aca3-aa206bd1c326', '9631358e-fd73-4668-ae01-f55ccd886506', '81113c19-4ac3-4472-9609-142a32f9cdc7', '601c34b8-d5bb-4995-80ba-ca5badb9f59d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Created reservations ['f7e4754b-7a8b-4e5c-9bdb-53e3c81c9d86', '41854150-1159-4983-80b8-ffa344d9df41', '909ee8f5-b97e-4367-a7ee-ca9dcc18998f', '89969b53-ad84-443f-9b76-59992f5aed49'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:32 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:32 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:32 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Delete snapshot completed successfully. Aug 09 12:57:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7b41464e-98d7-46e6-8e9d-a9180ccc01bd tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-68892680-ea83-411f-a533-a9ce6ebfd0ac-delete_snapshot" released by "delete_snapshot" :: held 2.473s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Flow 'volume_create_manager' (7daab343-a1c1-43c2-aaf9-a34356ef7205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b9c1b43-8d06-47e4-bcda-fc526f0ccb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Acquiring lock "cinder-aaf8f8fc-dbf0-4246-922c-6d81bb6632a7-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b9c1b43-8d06-47e4-bcda-fc526f0ccb63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1539951202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bc943e-8b1f-462b-8c2c-b6625bd870c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f00e94dd774f8f939c389e38ae0c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:33Z,use_quota=True,user_id='306678848ffb46b1ab4e736711a82016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b44f782-ae14-4cdf-9f3e-795ccfe37ecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b44f782-ae14-4cdf-9f3e-795ccfe37ecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed364b80-3325-4c18-bf49-8b8ff179b10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.image.glance [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Creating Keystone auth plugin from conf {{(pid=89309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Lock "cinder-aaf8f8fc-dbf0-4246-922c-6d81bb6632a7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Acquiring lock "cinder-quobyte-3e4e7c94-cb65-44ff-b270-924e9bbc3afa" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:33 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Lock "cinder-quobyte-3e4e7c94-cb65-44ff-b270-924e9bbc3afa" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Acquiring lock "cinder-quobyte-aaf8f8fc-dbf0-4246-922c-6d81bb6632a7" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.368s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:33 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Deleted volume successfully. Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Lock "cinder-quobyte-aaf8f8fc-dbf0-4246-922c-6d81bb6632a7" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Deleting offline snapshot aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 of volume 3e4e7c94-cb65-44ff-b270-924e9bbc3afa {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] snapshot_file for this snap is: volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-bb383e00-98c2-4177-a5c1-cf28671cdc44 tempest-TestStampPattern-316392764 None] Lock "cinder-f756d9ff-39ad-41e3-b69d-00f74d93df25-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f03ac65-3cca-4f14-bb5f-fae9f863e67b]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:33 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 Aug 09 12:57:33 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed364b80-3325-4c18-bf49-8b8ff179b10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '36bc943e-8b1f-462b-8c2c-b6625bd870c5', 'volume_name': 'volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d5b332-b9e1-42bc-8242-724bacf3bf9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d5b332-b9e1-42bc-8242-724bacf3bf9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdac2e32-16b4-4807-babf-5589a692ddb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:33 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Volume 36bc943e-8b1f-462b-8c2c-b6625bd870c5: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Trying to clone 36bc943e-8b1f-462b-8c2c-b6625bd870c5 from image edd103c7-208a-494c-8e8e-975b743b3cc4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]). {{(pid=89309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 12:57:33 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "cinder-ebe4c395-57d8-43bc-b999-234e335eee10-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7" returned: 0 in 0.475s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[db9f883d-8da7-4014-b498-2fec8fc48fb9]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-ebe4c395-57d8-43bc-b999-234e335eee10-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Flow 'volume_create_manager' (81b966ab-bc06-4604-8f7d-65ee411aad6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5664625c-305d-4d2d-b4f8-22b2b9e3d34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5664625c-305d-4d2d-b4f8-22b2b9e3d34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-281985181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4edb3ff1-7ddc-4152-86c8-db757d5a0b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f64352c4a749058ead62ff5f2e40b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:34Z,use_quota=True,user_id='9135f0743a3246efa4f35f43424e167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd00e46-bf16-4139-bfd2-df195ed4ae3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccd00e46-bf16-4139-bfd2-df195ed4ae3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7cf508-1ef7-427b-8cb2-ab6b1150d8c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea7cf508-1ef7-427b-8cb2-ab6b1150d8c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4edb3ff1-7ddc-4152-86c8-db757d5a0b50', 'volume_name': 'volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:33 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa Aug 09 12:57:33 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05354a79-95fc-46aa-bbd1-6fa51a1825f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05354a79-95fc-46aa-bbd1-6fa51a1825f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99af9d45-9305-4500-bfb7-fd9831114e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:33 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume 4edb3ff1-7ddc-4152-86c8-db757d5a0b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50', 'volume_size': 1} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-281985181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4edb3ff1-7ddc-4152-86c8-db757d5a0b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f64352c4a749058ead62ff5f2e40b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:34Z,use_quota=True,user_id='9135f0743a3246efa4f35f43424e167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Creating volume 4edb3ff1-7ddc-4152-86c8-db757d5a0b50 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:57:33 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:33 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 1073741824 Aug 09 12:57:33 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "cinder-quobyte-ebe4c395-57d8-43bc-b999-234e335eee10" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-quobyte-ebe4c395-57d8-43bc-b999-234e335eee10" acquired by "delete_volume" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bb47dee-bb2b-4cc8-8b52-0206025b513e]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 12:57:34 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Image download 20.69 MB at 20.69 MB/s Aug 09 12:57:34 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10 Aug 09 12:57:34 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c385d8c-e605-462d-8911-2fca02892697]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:34 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD Aug 09 12:57:34 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:34 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 1073741824" returned: 0 in 0.500s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:34 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa" returned: 0 in 0.684s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:34 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 Aug 09 12:57:34 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:34 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 Aug 09 12:57:34 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:34 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10" returned: 0 in 0.471s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:34 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10 Aug 09 12:57:34 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:34 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD" returned: 0 in 0.389s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Temporary image edd103c7-208a-494c-8e8e-975b743b3cc4 is fetched for user 306678848ffb46b1ab4e736711a82016. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[674bfe8e-df94-4083-99db-8eb594c1011d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:34 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50" returned: 0 in 0.318s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99af9d45-9305-4500-bfb7-fd9831114e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06840065-cd93-4753-a95e-16c73b05b72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:34 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 (4edb3ff1-7ddc-4152-86c8-db757d5a0b50): created successfully Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06840065-cd93-4753-a95e-16c73b05b72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Flow 'volume_create_manager' (81b966ab-bc06-4604-8f7d-65ee411aad6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:34 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-88b10aab-b7c5-4b16-ba6c-b3f8d84994e4 tempest-CreateVolumesFromSnapshotTest-955978690 None] Created volume successfully. Aug 09 12:57:34 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ebe4c395-57d8-43bc-b999-234e335eee10" returned: 0 in 0.341s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-quobyte-ebe4c395-57d8-43bc-b999-234e335eee10" released by "delete_volume" :: held 0.893s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:34 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7" returned: 0 in 0.468s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:34 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD Aug 09 12:57:34 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:34 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7 Aug 09 12:57:34 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Created reservations ['a9f9a2e3-b048-4798-8bbf-e11d08248e48', 'de5c2fe0-c968-4964-a14b-0631299f4765', '04b38559-d3a7-415a-aca4-f2fa880ee0fa', '9424538f-d0bd-43b7-81e0-35e10a96075d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:35 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:35 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:35 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD" returned: 0 in 0.393s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1539951202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36bc943e-8b1f-462b-8c2c-b6625bd870c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74f00e94dd774f8f939c389e38ae0c76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:33Z,use_quota=True,user_id='306678848ffb46b1ab4e736711a82016',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Creating volume 36bc943e-8b1f-462b-8c2c-b6625bd870c5 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:57:35 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:35 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 1073741824 Aug 09 12:57:35 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:35 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa.aaf8f8fc-dbf0-4246-922c-6d81bb6632a7" returned: 0 in 0.306s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Lock "cinder-quobyte-aaf8f8fc-dbf0-4246-922c-6d81bb6632a7" released by "_delete_snapshot" :: held 2.052s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Lock "cinder-quobyte-3e4e7c94-cb65-44ff-b270-924e9bbc3afa" released by "delete_snapshot" :: held 2.087s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:35 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.275s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:35 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Deleted volume successfully. Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Created reservations ['a0d52def-3dad-4e5d-9d59-f87d3c2712a2', '15dead49-6434-4630-976e-fc1bd83fb5ba', '05baa280-17a9-44be-8548-2b03dd5d7ba6', '7cf0e29c-5fb1-4435-b871-02fb4c133558'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0eb84e92-06ef-4c4d-9906-4db9daccfc63 tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-ebe4c395-57d8-43bc-b999-234e335eee10-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:35 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Delete snapshot completed successfully. Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9349ff02-799a-4bac-aa39-cd91e237a7ea tempest-TestStampPattern-316392764 None] Lock "cinder-aaf8f8fc-dbf0-4246-922c-6d81bb6632a7-delete_snapshot" released by "delete_snapshot" :: held 2.251s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:35 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 1073741824" returned: 0 in 0.454s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:35 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 Aug 09 12:57:35 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:35 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5" returned: 0 in 0.252s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Attempting download of edd103c7-208a-494c-8e8e-975b743b3cc4 ((None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}])) to volume 36bc943e-8b1f-462b-8c2c-b6625bd870c5. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "cinder-f75d5b0a-d857-4f40-973e-9461d2f09f61-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-f75d5b0a-d857-4f40-973e-9461d2f09f61-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] Creating offline snapshot 73175b6f-3c05-49e7-812c-403f16d8cd96 of volume 4edb3ff1-7ddc-4152-86c8-db757d5a0b50 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2247f15b-9c3d-4724-8d2c-86bbbe545c2a]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_12iw27j0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6eb52e-98ad-471a-8f6a-28ce3e5545c2]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "cinder-quobyte-f75d5b0a-d857-4f40-973e-9461d2f09f61" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-quobyte-f75d5b0a-d857-4f40-973e-9461d2f09f61" acquired by "delete_volume" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[643d6494-3a54-4a4e-82d6-2f9a6a22b834]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f75d5b0a-d857-4f40-973e-9461d2f09f61 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:36 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_12iw27j0 Aug 09 12:57:36 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:36 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 Aug 09 12:57:36 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:36 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f75d5b0a-d857-4f40-973e-9461d2f09f61 Aug 09 12:57:36 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:36 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_12iw27j0" returned: 0 in 0.391s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_12iw27j0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:36 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50" returned: 0 in 0.429s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:36 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 1G Aug 09 12:57:36 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:36 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_12iw27j0 Aug 09 12:57:36 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:36 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f75d5b0a-d857-4f40-973e-9461d2f09f61" returned: 0 in 0.419s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f75d5b0a-d857-4f40-973e-9461d2f09f61 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:36 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f75d5b0a-d857-4f40-973e-9461d2f09f61 Aug 09 12:57:36 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:36 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_12iw27j0" returned: 1 in 0.378s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_edd103c7-208a-494c-8e8e-975b743b3cc4_12iw27j0' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fab70f7-ccb2-46b0-99ab-933d7447888f]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:36 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f75d5b0a-d857-4f40-973e-9461d2f09f61" returned: 0 in 0.319s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-quobyte-f75d5b0a-d857-4f40-973e-9461d2f09f61" released by "delete_volume" :: held 0.803s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:36 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:36 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 1G" returned: 0 in 0.492s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:36 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Created reservations ['70f0c364-cb2d-4804-9fbe-056b3156da3f', '68aa08c0-f4b3-44b1-88be-584fd1960b63', 'fe09ee6e-5fc8-4663-a019-3e64664ee511', '9011fede-2646-4fd7-98dc-199295bb74c4'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:37 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 Aug 09 12:57:37 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:37 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:37 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:37 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96" returned: 0 in 0.477s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:37 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 is being set with open permissions: ugo+rw Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:37 devstack sudo[106667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 Aug 09 12:57:37 devstack sudo[106667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:37 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD" returned: 0 in 0.731s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] edd103c7-208a-494c-8e8e-975b743b3cc4 was qcow2, converting to qcow2 {{(pid=89309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:37 devstack sudo[106671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 Aug 09 12:57:37 devstack sudo[106671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:37 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.495s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:37 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Deleted volume successfully. Aug 09 12:57:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d5b7a140-a6bc-4744-8c54-8c378da424a7 tempest-CinderUnicodeTest-1025713832 None] Lock "cinder-f75d5b0a-d857-4f40-973e-9461d2f09f61-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:38 devstack sudo[106667]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96" returned: 0 in 0.583s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:38 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.info Aug 09 12:57:38 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:38 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.info" returned: 0 in 0.410s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:38 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.info is being set with open permissions: ugo+rw Aug 09 12:57:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:38 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.info Aug 09 12:57:38 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:39 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.info" returned: 0 in 0.526s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.127s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:39 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d7403b0c-f57b-424e-a7eb-53e4fb661ae5 tempest-CreateVolumesFromSnapshotTest-955978690 None] Create snapshot completed successfully Aug 09 12:57:40 devstack sudo[106671]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5" returned: 0 in 2.696s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_edd103c7-208a-494c-8e8e-975b743b3cc4_fl0bjpxcdevstack@QuobyteHD, size 112.00 MB, duration 2.70 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:57:40 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Converted 112.00 MB image at 41.52 MB/s Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:40 devstack sudo[106717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 1G Aug 09 12:57:40 devstack sudo[106717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:40 devstack sudo[106717]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 1G" returned: 0 in 0.416s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Downloaded image edd103c7-208a-494c-8e8e-975b743b3cc4 ((None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}])) to volume 36bc943e-8b1f-462b-8c2c-b6625bd870c5 successfully. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Temporary image edd103c7-208a-494c-8e8e-975b743b3cc4 for user 306678848ffb46b1ab4e736711a82016 is deleted. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Marking volume 36bc943e-8b1f-462b-8c2c-b6625bd870c5 as bootable. {{(pid=89309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Copying metadata from image edd103c7-208a-494c-8e8e-975b743b3cc4 to 36bc943e-8b1f-462b-8c2c-b6625bd870c5. {{(pid=89309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Creating volume glance metadata for volume 36bc943e-8b1f-462b-8c2c-b6625bd870c5 backed by image edd103c7-208a-494c-8e8e-975b743b3cc4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=89309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Acquiring lock "cinder-3e4e7c94-cb65-44ff-b270-924e9bbc3afa-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Flow 'volume_create_manager' (5a178537-834a-41ec-a807-bfd86c9c47c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b923c33c-d952-4afd-ae2e-62830bb9ffc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b923c33c-d952-4afd-ae2e-62830bb9ffc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1368529119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adfb303-8241-4dd2-ba26-bd47a30f8f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f64352c4a749058ead62ff5f2e40b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:41Z,use_quota=True,user_id='9135f0743a3246efa4f35f43424e167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd0775b-3d2b-41c6-9d2c-8a3c2d2c6f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5cd0775b-3d2b-41c6-9d2c-8a3c2d2c6f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82ad977-5d2b-441f-af0c-f94855ac141f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b82ad977-5d2b-441f-af0c-f94855ac141f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5adfb303-8241-4dd2-ba26-bd47a30f8f0f', 'volume_name': 'volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3031cf60-5d99-4497-a201-2e7f280b4f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3031cf60-5d99-4497-a201-2e7f280b4f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8948bf-90ad-43bf-b1f6-32218a6a7171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:40 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume 5adfb303-8241-4dd2-ba26-bd47a30f8f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f', 'volume_size': 1} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1368529119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5adfb303-8241-4dd2-ba26-bd47a30f8f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f64352c4a749058ead62ff5f2e40b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:41Z,use_quota=True,user_id='9135f0743a3246efa4f35f43424e167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Creating volume 5adfb303-8241-4dd2-ba26-bd47a30f8f0f {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:57:40 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:57:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Lock "cinder-3e4e7c94-cb65-44ff-b270-924e9bbc3afa-delete_volume" acquired by "delete_volume" :: waited 0.161s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:41 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f 1073741824 Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdac2e32-16b4-4807-babf-5589a692ddb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5', 'volume_size': 1, 'image_id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/edd103c7-208a-494c-8e8e-975b743b3cc4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e5a66bd7ff3f4044a690c9e9c0a0a7c0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'edd103c7-208a-494c-8e8e-975b743b3cc4', 'created_at': datetime.datetime(2026, 8, 9, 10, 36, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 10, 36, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/edd103c7-208a-494c-8e8e-975b743b3cc4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:41 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274c2ae2-1f81-4bf4-97c9-511b7cc2b7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:41 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Volume volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 (36bc943e-8b1f-462b-8c2c-b6625bd870c5): created successfully Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (274c2ae2-1f81-4bf4-97c9-511b7cc2b7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Flow 'volume_create_manager' (7daab343-a1c1-43c2-aaf9-a34356ef7205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:41 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-7a310fde-353a-4129-bcea-468b54e534a3 tempest-TestShelveInstance-344820939 None] Created volume successfully. Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Acquiring lock "cinder-quobyte-3e4e7c94-cb65-44ff-b270-924e9bbc3afa" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Lock "cinder-quobyte-3e4e7c94-cb65-44ff-b270-924e9bbc3afa" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b6ba95-48a7-464c-a84e-7302978b5205]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Flow 'volume_create_manager' (faaa6081-d8fd-4919-b69d-cc1f80a07127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:41 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa Aug 09 12:57:41 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5be27cb-e316-4c72-9185-649192a0fa4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5be27cb-e316-4c72-9185-649192a0fa4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-184040019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e370e0-3698-4f45-9fc6-b09b6561d879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f64352c4a749058ead62ff5f2e40b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:41Z,use_quota=True,user_id='9135f0743a3246efa4f35f43424e167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dce0e0-bac2-42ad-b023-447f3ddc27f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83dce0e0-bac2-42ad-b023-447f3ddc27f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7ff4e9-d03e-4686-b4e5-05aa452f7fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd7ff4e9-d03e-4686-b4e5-05aa452f7fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7e370e0-3698-4f45-9fc6-b09b6561d879', 'volume_name': 'volume-f7e370e0-3698-4f45-9fc6-b09b6561d879', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2e9b39-c6e3-4b80-9b2f-60c7f862cc16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c2e9b39-c6e3-4b80-9b2f-60c7f862cc16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b6cf46-9b3e-4543-b3d6-2536b5d99f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:41 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume f7e370e0-3698-4f45-9fc6-b09b6561d879: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7e370e0-3698-4f45-9fc6-b09b6561d879', 'volume_size': 1} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:41 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f 1073741824" returned: 0 in 0.714s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:41 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa" returned: 0 in 0.552s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:41 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa Aug 09 12:57:41 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:41 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f Aug 09 12:57:41 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:42 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3e4e7c94-cb65-44ff-b270-924e9bbc3afa" returned: 0 in 0.394s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Lock "cinder-quobyte-3e4e7c94-cb65-44ff-b270-924e9bbc3afa" released by "delete_volume" :: held 1.057s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:42 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f" returned: 0 in 0.409s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.755s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-184040019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7e370e0-3698-4f45-9fc6-b09b6561d879,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f64352c4a749058ead62ff5f2e40b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:41Z,use_quota=True,user_id='9135f0743a3246efa4f35f43424e167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Creating volume f7e370e0-3698-4f45-9fc6-b09b6561d879 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:57:42 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f7e370e0-3698-4f45-9fc6-b09b6561d879 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:42 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f7e370e0-3698-4f45-9fc6-b09b6561d879 1073741824 Aug 09 12:57:42 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b8948bf-90ad-43bf-b1f6-32218a6a7171) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f800d13-bd9b-4d91-bdb4-b90980bd0731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:42 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f (5adfb303-8241-4dd2-ba26-bd47a30f8f0f): created successfully Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f800d13-bd9b-4d91-bdb4-b90980bd0731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Flow 'volume_create_manager' (5a178537-834a-41ec-a807-bfd86c9c47c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Flow 'volume_create_manager' (0be8dfb3-f473-40c7-9970-9142e692885e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9de0d87-399f-4c89-9c60-62d0943a704f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:42 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-44f88d41-9c87-429b-b1e0-c61a6c9c6744 tempest-CreateVolumesFromSnapshotTest-955978690 None] Created volume successfully. Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9de0d87-399f-4c89-9c60-62d0943a704f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-722921895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493e9666-0423-4053-8861-c2543aa01d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f64352c4a749058ead62ff5f2e40b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:42Z,use_quota=True,user_id='9135f0743a3246efa4f35f43424e167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71d7bcb-c62e-43e0-ab64-61decbecb0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a71d7bcb-c62e-43e0-ab64-61decbecb0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0aa4ce2-e3f8-40a1-80c6-9fcd8149d4c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0aa4ce2-e3f8-40a1-80c6-9fcd8149d4c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '493e9666-0423-4053-8861-c2543aa01d75', 'volume_name': 'volume-493e9666-0423-4053-8861-c2543aa01d75', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa5b524-a067-4e61-973a-d93a5cd68232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6aa5b524-a067-4e61-973a-d93a5cd68232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435dff33-2963-4337-865a-5a962d9508b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:42 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume 493e9666-0423-4053-8861-c2543aa01d75: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-493e9666-0423-4053-8861-c2543aa01d75', 'volume_size': 1} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Created reservations ['d0183c55-130d-41a1-9b56-35f437fa7152', '72ab6d6d-4a8c-4ced-9701-317840ef824d', '5d6f9492-73b8-4136-9d5e-158bc2f3fb6e', '5b09bd7c-2f7d-457e-8dd9-0612e02c5f6c'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:42 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:42 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Flow 'volume_create_manager' (814b22e4-13a6-4f88-b8ab-7a672966be66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af54b2b4-72e7-4516-b493-04a853beca6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af54b2b4-72e7-4516-b493-04a853beca6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-920527074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06aebaf2-5709-4614-a543-ab7a530e15aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f64352c4a749058ead62ff5f2e40b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:43Z,use_quota=True,user_id='9135f0743a3246efa4f35f43424e167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb4a23c-facb-4f91-9a84-5c1a64e0b744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bb4a23c-facb-4f91-9a84-5c1a64e0b744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0757e2dc-6909-4bbf-92cf-4308fc5cf905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0757e2dc-6909-4bbf-92cf-4308fc5cf905) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06aebaf2-5709-4614-a543-ab7a530e15aa', 'volume_name': 'volume-06aebaf2-5709-4614-a543-ab7a530e15aa', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d49506f-c847-4593-81d9-52b08ca1f4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d49506f-c847-4593-81d9-52b08ca1f4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b26661-dbd8-4e4f-997c-f8497239a540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:42 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume 06aebaf2-5709-4614-a543-ab7a530e15aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06aebaf2-5709-4614-a543-ab7a530e15aa', 'volume_size': 1} Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:42 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f7e370e0-3698-4f45-9fc6-b09b6561d879 1073741824" returned: 0 in 0.738s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f7e370e0-3698-4f45-9fc6-b09b6561d879 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:43 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f7e370e0-3698-4f45-9fc6-b09b6561d879 Aug 09 12:57:43 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:43 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.420s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:43 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Deleted volume successfully. Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-386bb5f5-bc77-43e9-9547-fb11998a9235 tempest-TestStampPattern-316392764 None] Lock "cinder-3e4e7c94-cb65-44ff-b270-924e9bbc3afa-delete_volume" released by "delete_volume" :: held 2.199s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:43 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f7e370e0-3698-4f45-9fc6-b09b6561d879" returned: 0 in 0.333s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.124s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.766s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-722921895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=493e9666-0423-4053-8861-c2543aa01d75,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f64352c4a749058ead62ff5f2e40b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:42Z,use_quota=True,user_id='9135f0743a3246efa4f35f43424e167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Creating volume 493e9666-0423-4053-8861-c2543aa01d75 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:57:43 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-493e9666-0423-4053-8861-c2543aa01d75 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (50b6cf46-9b3e-4543-b3d6-2536b5d99f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7e370e0-3698-4f45-9fc6-b09b6561d879', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a0c152-57d3-47b8-8ab0-02d5295d850e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:43 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-493e9666-0423-4053-8861-c2543aa01d75 1073741824 Aug 09 12:57:43 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:43 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume volume-f7e370e0-3698-4f45-9fc6-b09b6561d879 (f7e370e0-3698-4f45-9fc6-b09b6561d879): created successfully Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a0c152-57d3-47b8-8ab0-02d5295d850e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Flow 'volume_create_manager' (faaa6081-d8fd-4919-b69d-cc1f80a07127) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Flow 'volume_create_manager' (b2060797-469c-457b-9d36-292a8718bfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9ea536-c89e-48a7-b69e-a1982ecea455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:43 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f59a335a-006b-4459-bee0-313f88a9d97d tempest-CreateVolumesFromSnapshotTest-955978690 None] Created volume successfully. Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf9ea536-c89e-48a7-b69e-a1982ecea455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1391203560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4268da2c-a9b8-4bb5-ba89-161c4ce0867d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f64352c4a749058ead62ff5f2e40b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:43Z,use_quota=True,user_id='9135f0743a3246efa4f35f43424e167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d82abf-ee2d-42ef-b292-5546dfaaddf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1d82abf-ee2d-42ef-b292-5546dfaaddf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550f2446-5962-44f3-a6c9-30ac24f614c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (550f2446-5962-44f3-a6c9-30ac24f614c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4268da2c-a9b8-4bb5-ba89-161c4ce0867d', 'volume_name': 'volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2f8733-8994-4a5c-90be-d415d8437838) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce2f8733-8994-4a5c-90be-d415d8437838) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acabd0df-70fe-422e-8b79-55069e5c0686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:43 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume 4268da2c-a9b8-4bb5-ba89-161c4ce0867d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d', 'volume_size': 1} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Flow 'volume_create_manager' (3faa45e8-6274-4d63-a2b8-e6a127465311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ce2983-9025-4144-bbea-699a8da97b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ce2983-9025-4144-bbea-699a8da97b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1761749041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84716c06-4514-45da-ac1e-152f528e06b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7eef20f4b745dab6e0dab7a441be6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:44Z,use_quota=True,user_id='85af341ad0d646bcb664adf6a2a467bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501074ea-5634-4b14-b052-465298f74e0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (501074ea-5634-4b14-b052-465298f74e0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb268b3-e230-473a-b44c-f307a22b4b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb268b3-e230-473a-b44c-f307a22b4b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84716c06-4514-45da-ac1e-152f528e06b0', 'volume_name': 'volume-84716c06-4514-45da-ac1e-152f528e06b0', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de656b38-1877-4138-9955-ad714c94181e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de656b38-1877-4138-9955-ad714c94181e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8190ddf0-67f0-4a78-bd00-f7bb46e815e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:44 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Volume 84716c06-4514-45da-ac1e-152f528e06b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84716c06-4514-45da-ac1e-152f528e06b0', 'volume_size': 1} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:44 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-493e9666-0423-4053-8861-c2543aa01d75 1073741824" returned: 0 in 0.782s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-493e9666-0423-4053-8861-c2543aa01d75 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:44 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-493e9666-0423-4053-8861-c2543aa01d75 Aug 09 12:57:44 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:44 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-493e9666-0423-4053-8861-c2543aa01d75" returned: 0 in 0.289s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.520s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-920527074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06aebaf2-5709-4614-a543-ab7a530e15aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f64352c4a749058ead62ff5f2e40b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:43Z,use_quota=True,user_id='9135f0743a3246efa4f35f43424e167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Creating volume 06aebaf2-5709-4614-a543-ab7a530e15aa {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:57:44 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-06aebaf2-5709-4614-a543-ab7a530e15aa 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:44 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-06aebaf2-5709-4614-a543-ab7a530e15aa 1073741824 Aug 09 12:57:44 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (435dff33-2963-4337-865a-5a962d9508b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-493e9666-0423-4053-8861-c2543aa01d75', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424fee67-bc7d-42eb-b4ad-3fc0b656de4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:44 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume volume-493e9666-0423-4053-8861-c2543aa01d75 (493e9666-0423-4053-8861-c2543aa01d75): created successfully Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424fee67-bc7d-42eb-b4ad-3fc0b656de4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Flow 'volume_create_manager' (0be8dfb3-f473-40c7-9970-9142e692885e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-99b1a53b-2445-4e82-aa51-511ee2b117c8 tempest-CreateVolumesFromSnapshotTest-955978690 None] Created volume successfully. Aug 09 12:57:45 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-06aebaf2-5709-4614-a543-ab7a530e15aa 1073741824" returned: 0 in 0.653s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-06aebaf2-5709-4614-a543-ab7a530e15aa {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:45 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-06aebaf2-5709-4614-a543-ab7a530e15aa Aug 09 12:57:45 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:45 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-06aebaf2-5709-4614-a543-ab7a530e15aa" returned: 0 in 0.334s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.943s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1391203560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4268da2c-a9b8-4bb5-ba89-161c4ce0867d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0f64352c4a749058ead62ff5f2e40b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:43Z,use_quota=True,user_id='9135f0743a3246efa4f35f43424e167b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Creating volume 4268da2c-a9b8-4bb5-ba89-161c4ce0867d {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:57:45 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90b26661-dbd8-4e4f-997c-f8497239a540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06aebaf2-5709-4614-a543-ab7a530e15aa', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3abed73d-8ac1-4a20-abfa-126fda2ae6f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:45 devstack sudo[106780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d 1073741824 Aug 09 12:57:45 devstack sudo[106780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:45 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume volume-06aebaf2-5709-4614-a543-ab7a530e15aa (06aebaf2-5709-4614-a543-ab7a530e15aa): created successfully Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3abed73d-8ac1-4a20-abfa-126fda2ae6f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Flow 'volume_create_manager' (814b22e4-13a6-4f88-b8ab-7a672966be66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:45 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-896483b2-4ea1-4b81-98d4-a8bb4ed28766 tempest-CreateVolumesFromSnapshotTest-955978690 None] Created volume successfully. Aug 09 12:57:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-d6ea7b29-6fe2-4eb1-8924-85dae405fbcf req-4917fa92-1360-4821-8173-d5dcae0250a4 tempest-TestShelveInstance-344820939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:46 devstack sudo[106780]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d 1073741824" returned: 0 in 0.658s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:46 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d Aug 09 12:57:46 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:46 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d" returned: 0 in 0.341s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.555s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1761749041',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84716c06-4514-45da-ac1e-152f528e06b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7eef20f4b745dab6e0dab7a441be6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:44Z,use_quota=True,user_id='85af341ad0d646bcb664adf6a2a467bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Creating volume 84716c06-4514-45da-ac1e-152f528e06b0 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:57:46 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-84716c06-4514-45da-ac1e-152f528e06b0 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:46 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-84716c06-4514-45da-ac1e-152f528e06b0 1073741824 Aug 09 12:57:46 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acabd0df-70fe-422e-8b79-55069e5c0686) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abf82ab-883c-42b2-83e7-90be9754e872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:46 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Volume volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d (4268da2c-a9b8-4bb5-ba89-161c4ce0867d): created successfully Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2abf82ab-883c-42b2-83e7-90be9754e872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Flow 'volume_create_manager' (b2060797-469c-457b-9d36-292a8718bfb0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:46 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2f1213d5-36fd-48f8-9831-d7919e64da85 tempest-CreateVolumesFromSnapshotTest-955978690 None] Created volume successfully. Aug 09 12:57:47 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-84716c06-4514-45da-ac1e-152f528e06b0 1073741824" returned: 0 in 0.665s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-84716c06-4514-45da-ac1e-152f528e06b0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:47 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-84716c06-4514-45da-ac1e-152f528e06b0 Aug 09 12:57:47 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-4268da2c-a9b8-4bb5-ba89-161c4ce0867d-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-4268da2c-a9b8-4bb5-ba89-161c4ce0867d-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-quobyte-4268da2c-a9b8-4bb5-ba89-161c4ce0867d" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-4268da2c-a9b8-4bb5-ba89-161c4ce0867d" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f149b71f-ab4d-4d9f-9376-4b56f0201863]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:47 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d Aug 09 12:57:47 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:47 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-84716c06-4514-45da-ac1e-152f528e06b0" returned: 0 in 0.378s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-d6ea7b29-6fe2-4eb1-8924-85dae405fbcf req-4917fa92-1360-4821-8173-d5dcae0250a4 tempest-TestShelveInstance-344820939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.927s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8190ddf0-67f0-4a78-bd00-f7bb46e815e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84716c06-4514-45da-ac1e-152f528e06b0', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e51a34-1079-47e8-a334-cafb8467903f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-d6ea7b29-6fe2-4eb1-8924-85dae405fbcf req-4917fa92-1360-4821-8173-d5dcae0250a4 tempest-TestShelveInstance-344820939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.040s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:47 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Volume volume-84716c06-4514-45da-ac1e-152f528e06b0 (84716c06-4514-45da-ac1e-152f528e06b0): created successfully Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0e51a34-1079-47e8-a334-cafb8467903f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Flow 'volume_create_manager' (3faa45e8-6274-4d63-a2b8-e6a127465311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:47 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b0c9032c-faa1-42fe-b100-3484af4a7083 tempest-ProjectReaderTests-601796347 None] Created volume successfully. Aug 09 12:57:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-d6ea7b29-6fe2-4eb1-8924-85dae405fbcf req-4917fa92-1360-4821-8173-d5dcae0250a4 tempest-TestShelveInstance-344820939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9bcb6136-af9f-4d4d-b106-5a4c8a147999', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:57:47 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-d6ea7b29-6fe2-4eb1-8924-85dae405fbcf req-4917fa92-1360-4821-8173-d5dcae0250a4 tempest-TestShelveInstance-344820939 None] attachment_update completed successfully. Aug 09 12:57:48 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d" returned: 0 in 0.483s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:48 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d Aug 09 12:57:48 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:48 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4268da2c-a9b8-4bb5-ba89-161c4ce0867d" returned: 0 in 0.333s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-4268da2c-a9b8-4bb5-ba89-161c4ce0867d" released by "delete_volume" :: held 0.885s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Acquiring lock "cinder-84716c06-4514-45da-ac1e-152f528e06b0-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Created reservations ['619855f5-8633-46e4-9dbf-a16cbd288258', '410879f5-7f81-4247-a3ca-d51931ca530e', 'a8e02196-0b26-4d02-8cbc-02be93c230a6', 'd47bfb02-fe5d-476a-bfdd-f96b9edfab0e'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Lock "cinder-84716c06-4514-45da-ac1e-152f528e06b0-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Acquiring lock "cinder-quobyte-84716c06-4514-45da-ac1e-152f528e06b0" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Lock "cinder-quobyte-84716c06-4514-45da-ac1e-152f528e06b0" acquired by "delete_volume" :: waited 0.034s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d23b366d-d0b6-4d28-bc3b-81902ce30652]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-84716c06-4514-45da-ac1e-152f528e06b0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:48 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:48 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:48 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-84716c06-4514-45da-ac1e-152f528e06b0 Aug 09 12:57:48 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:49 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.368s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:49 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:49 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Deleted volume successfully. Aug 09 12:57:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9db9d304-b5c6-4ed7-a677-829a099e1390 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-4268da2c-a9b8-4bb5-ba89-161c4ce0867d-delete_volume" released by "delete_volume" :: held 1.767s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:49 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-84716c06-4514-45da-ac1e-152f528e06b0" returned: 0 in 0.677s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-84716c06-4514-45da-ac1e-152f528e06b0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:49 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-84716c06-4514-45da-ac1e-152f528e06b0 Aug 09 12:57:49 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-06aebaf2-5709-4614-a543-ab7a530e15aa-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-06aebaf2-5709-4614-a543-ab7a530e15aa-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-quobyte-06aebaf2-5709-4614-a543-ab7a530e15aa" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-06aebaf2-5709-4614-a543-ab7a530e15aa" acquired by "delete_volume" :: waited 0.035s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:49 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dd1c86-4d3f-4f13-ad69-0933d55a7bd4]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-06aebaf2-5709-4614-a543-ab7a530e15aa {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:50 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-84716c06-4514-45da-ac1e-152f528e06b0" returned: 0 in 0.644s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Lock "cinder-quobyte-84716c06-4514-45da-ac1e-152f528e06b0" released by "delete_volume" :: held 1.414s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Created reservations ['20ac2a64-9f00-4696-9b34-0096548578a2', '265f9705-e5ae-468e-8d0d-f1ab0c245857', '29cdf0ff-6630-454e-b3c9-bc3511c28908', '4c706b23-654d-4d05-b6f2-f4398603c320'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:50 devstack sudo[107276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-06aebaf2-5709-4614-a543-ab7a530e15aa Aug 09 12:57:50 devstack sudo[107276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:50 devstack sudo[107293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:50 devstack sudo[107293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:50 devstack sudo[107276]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-06aebaf2-5709-4614-a543-ab7a530e15aa" returned: 0 in 0.714s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-06aebaf2-5709-4614-a543-ab7a530e15aa {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:50 devstack sudo[107303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-06aebaf2-5709-4614-a543-ab7a530e15aa Aug 09 12:57:50 devstack sudo[107303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:50 devstack sudo[107293]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.459s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:50 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Deleted volume successfully. Aug 09 12:57:50 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1fb0afc6-6f5b-4376-b720-e8b1efaa00a5 tempest-ProjectReaderTests-601796347 None] Lock "cinder-84716c06-4514-45da-ac1e-152f528e06b0-delete_volume" released by "delete_volume" :: held 2.287s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:51 devstack sudo[107303]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-06aebaf2-5709-4614-a543-ab7a530e15aa" returned: 0 in 0.344s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-06aebaf2-5709-4614-a543-ab7a530e15aa" released by "delete_volume" :: held 1.136s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Created reservations ['6f39788a-a895-4df8-89e6-822eca6a6b14', 'b2999f9d-caca-4e6c-b5a7-3f1b1e912828', '3c8e0737-8055-41a0-87e4-61e69006ae8f', '297e3961-f4b0-4081-8c0d-f80e98eb1afa'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:51 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:51 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Flow 'volume_create_manager' (1a3be138-c47d-454b-93ce-20dac036e830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bb03d3-3a8a-46e8-b5c6-47fc4c1812e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:51 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.385s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bb03d3-3a8a-46e8-b5c6-47fc4c1812e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-42946119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa147895-9097-4490-ad19-6fb3e2920373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7eef20f4b745dab6e0dab7a441be6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:51Z,use_quota=True,user_id='85af341ad0d646bcb664adf6a2a467bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223d897f-3225-4bf7-81c8-df9828c0d1fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (223d897f-3225-4bf7-81c8-df9828c0d1fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8227ef84-342d-444e-9932-a2901401d404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8227ef84-342d-444e-9932-a2901401d404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa147895-9097-4490-ad19-6fb3e2920373', 'volume_name': 'volume-aa147895-9097-4490-ad19-6fb3e2920373', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387d8588-9f51-412c-b338-f628a4bc1ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (387d8588-9f51-412c-b338-f628a4bc1ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e463592-61cd-4512-bf9d-48347c183423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:51 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Volume aa147895-9097-4490-ad19-6fb3e2920373: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa147895-9097-4490-ad19-6fb3e2920373', 'volume_size': 1} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:57:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-42946119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa147895-9097-4490-ad19-6fb3e2920373,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8e7eef20f4b745dab6e0dab7a441be6d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:57:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:57:51Z,use_quota=True,user_id='85af341ad0d646bcb664adf6a2a467bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Creating volume aa147895-9097-4490-ad19-6fb3e2920373 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:57:51 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aa147895-9097-4490-ad19-6fb3e2920373 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:51 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Deleted volume successfully. Aug 09 12:57:51 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aa147895-9097-4490-ad19-6fb3e2920373 1073741824 Aug 09 12:57:51 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-63a3d478-622f-485b-bd3d-35fcff270cfa tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-06aebaf2-5709-4614-a543-ab7a530e15aa-delete_volume" released by "delete_volume" :: held 1.987s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-493e9666-0423-4053-8861-c2543aa01d75-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-493e9666-0423-4053-8861-c2543aa01d75-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-quobyte-493e9666-0423-4053-8861-c2543aa01d75" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-493e9666-0423-4053-8861-c2543aa01d75" acquired by "delete_volume" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:52 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b879cc-df1a-4646-aa03-83ca3bcc7b2d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-493e9666-0423-4053-8861-c2543aa01d75 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:52 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-493e9666-0423-4053-8861-c2543aa01d75 Aug 09 12:57:52 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:52 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aa147895-9097-4490-ad19-6fb3e2920373 1073741824" returned: 0 in 0.800s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aa147895-9097-4490-ad19-6fb3e2920373 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:52 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aa147895-9097-4490-ad19-6fb3e2920373 Aug 09 12:57:52 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:52 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-493e9666-0423-4053-8861-c2543aa01d75" returned: 0 in 0.665s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-493e9666-0423-4053-8861-c2543aa01d75 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:53 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-493e9666-0423-4053-8861-c2543aa01d75 Aug 09 12:57:53 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:53 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aa147895-9097-4490-ad19-6fb3e2920373" returned: 0 in 0.734s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.611s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e463592-61cd-4512-bf9d-48347c183423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa147895-9097-4490-ad19-6fb3e2920373', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628e8746-d6d5-462a-ae59-6b7dabadf76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:57:53 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-493e9666-0423-4053-8861-c2543aa01d75" returned: 0 in 0.444s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:53 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Volume volume-aa147895-9097-4490-ad19-6fb3e2920373 (aa147895-9097-4490-ad19-6fb3e2920373): created successfully Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628e8746-d6d5-462a-ae59-6b7dabadf76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Flow 'volume_create_manager' (1a3be138-c47d-454b-93ce-20dac036e830) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-493e9666-0423-4053-8861-c2543aa01d75" released by "delete_volume" :: held 1.193s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:53 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-9ce09049-281c-4a64-9d69-8d530017a4e5 tempest-ProjectReaderTests-601796347 None] Created volume successfully. Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Created reservations ['212e2198-7785-4356-9a59-2cc8b75e5c51', '596bf8d2-9a24-4e2b-adac-27d139c0fc53', '7c6214e4-ed19-4725-aa0f-bee7a30f0c90', '4fef5a33-7cfe-4ba6-be4f-42b7f7e4784d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:53 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:53 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Acquiring lock "cinder-aa147895-9097-4490-ad19-6fb3e2920373-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Lock "cinder-aa147895-9097-4490-ad19-6fb3e2920373-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Acquiring lock "cinder-quobyte-aa147895-9097-4490-ad19-6fb3e2920373" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Lock "cinder-quobyte-aa147895-9097-4490-ad19-6fb3e2920373" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9dda2de-0964-4c0a-846e-72582fa9f240]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aa147895-9097-4490-ad19-6fb3e2920373 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:54 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.390s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:54 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:54 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Deleted volume successfully. Aug 09 12:57:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-666db74a-6151-4676-a33e-7382ba03936e tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-493e9666-0423-4053-8861-c2543aa01d75-delete_volume" released by "delete_volume" :: held 1.952s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:54 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aa147895-9097-4490-ad19-6fb3e2920373 Aug 09 12:57:54 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:54 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aa147895-9097-4490-ad19-6fb3e2920373" returned: 0 in 0.525s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aa147895-9097-4490-ad19-6fb3e2920373 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-f7e370e0-3698-4f45-9fc6-b09b6561d879-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:54 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aa147895-9097-4490-ad19-6fb3e2920373 Aug 09 12:57:54 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-f7e370e0-3698-4f45-9fc6-b09b6561d879-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-quobyte-f7e370e0-3698-4f45-9fc6-b09b6561d879" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-f7e370e0-3698-4f45-9fc6-b09b6561d879" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:54 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[36797bf7-85ae-4aab-8f9d-2cf71aa10ec2]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f7e370e0-3698-4f45-9fc6-b09b6561d879 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:54 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f7e370e0-3698-4f45-9fc6-b09b6561d879 Aug 09 12:57:54 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:54 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aa147895-9097-4490-ad19-6fb3e2920373" returned: 0 in 0.435s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Lock "cinder-quobyte-aa147895-9097-4490-ad19-6fb3e2920373" released by "delete_volume" :: held 1.037s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Created reservations ['91a62168-c4d1-4ceb-a935-15229edc0e99', 'f904ec15-ee62-41e2-b6fd-2e0576d8abe9', '5822b2b4-9586-4705-ba23-ab9755aab141', 'e963d34b-b124-4a22-82c3-1fbe95f66a02'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:55 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:55 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:55 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f7e370e0-3698-4f45-9fc6-b09b6561d879" returned: 0 in 0.655s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f7e370e0-3698-4f45-9fc6-b09b6561d879 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:55 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f7e370e0-3698-4f45-9fc6-b09b6561d879 Aug 09 12:57:55 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:55 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.368s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:55 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Deleted volume successfully. Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ab9361f5-0a25-490a-a559-ff9d555b3868 tempest-ProjectReaderTests-601796347 None] Lock "cinder-aa147895-9097-4490-ad19-6fb3e2920373-delete_volume" released by "delete_volume" :: held 1.833s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:55 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f7e370e0-3698-4f45-9fc6-b09b6561d879" returned: 0 in 0.388s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-f7e370e0-3698-4f45-9fc6-b09b6561d879" released by "delete_volume" :: held 1.110s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Created reservations ['591fae55-4e7b-4405-9ee1-b74190690662', '265adc7c-a54e-4c0b-bb85-efb0f04a0eba', 'a7f5460c-1ee2-4fe5-9d96-abbbd986901f', 'e3e50a72-25d6-4278-b881-bdd69ed596cc'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:55 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:55 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:56 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.496s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:56 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:56 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Deleted volume successfully. Aug 09 12:57:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-47c93326-f77b-462c-835e-9735592426a0 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-f7e370e0-3698-4f45-9fc6-b09b6561d879-delete_volume" released by "delete_volume" :: held 1.949s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-5adfb303-8241-4dd2-ba26-bd47a30f8f0f-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-5adfb303-8241-4dd2-ba26-bd47a30f8f0f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-quobyte-5adfb303-8241-4dd2-ba26-bd47a30f8f0f" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:57 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-5adfb303-8241-4dd2-ba26-bd47a30f8f0f" acquired by "delete_volume" :: waited 0.034s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:57 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[57b565a7-bfa5-47ae-b8ac-82c7a43f62d9]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:57 devstack sudo[107385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f Aug 09 12:57:57 devstack sudo[107385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:57 devstack sudo[107385]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f" returned: 0 in 0.629s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:57:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:57 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f Aug 09 12:57:57 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:57 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:57 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:58 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-5adfb303-8241-4dd2-ba26-bd47a30f8f0f" returned: 0 in 0.493s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-5adfb303-8241-4dd2-ba26-bd47a30f8f0f" released by "delete_volume" :: held 1.214s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:58 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.522s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Created reservations ['43230f58-c9de-4e13-a57b-32526b4fdc55', '5fd15e91-d33a-4521-b82c-8d3171eeafc5', '89820b15-dee4-4a7d-9a6c-42602586b9f3', '4b89665d-cc79-4eaf-8e46-8a08ea479582'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:57:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:58 devstack sudo[107398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:57:58 devstack sudo[107398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:59 devstack sudo[107398]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.370s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:57:59 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Deleted volume successfully. Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-adcddf1a-ba3a-492a-a465-9c4f421fbad1 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-5adfb303-8241-4dd2-ba26-bd47a30f8f0f-delete_volume" released by "delete_volume" :: held 2.118s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-73175b6f-3c05-49e7-812c-403f16d8cd96-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-73175b6f-3c05-49e7-812c-403f16d8cd96-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-quobyte-4edb3ff1-7ddc-4152-86c8-db757d5a0b50" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-4edb3ff1-7ddc-4152-86c8-db757d5a0b50" acquired by "delete_snapshot" :: waited 0.036s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-quobyte-73175b6f-3c05-49e7-812c-403f16d8cd96" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-73175b6f-3c05-49e7-812c-403f16d8cd96" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Deleting offline snapshot 73175b6f-3c05-49e7-812c-403f16d8cd96 of volume 4edb3ff1-7ddc-4152-86c8-db757d5a0b50 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] snapshot_file for this snap is: volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[349f3c21-1308-4ae1-b7f5-247f5c775513]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:57:59 devstack sudo[107402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 Aug 09 12:57:59 devstack sudo[107402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:57:59 devstack sudo[107402]: pam_unix(sudo:session): session closed for user root Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96" returned: 0 in 0.553s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:57:59 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:58:00 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dc65a7a-4e25-4ea7-8633-92b1988ec4c5]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:00 devstack sudo[107407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 Aug 09 12:58:00 devstack sudo[107407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:00 devstack sudo[107407]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50" returned: 0 in 0.546s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:00 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 Aug 09 12:58:00 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:01 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96" returned: 0 in 0.506s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:01 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96 Aug 09 12:58:01 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:01 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50.73175b6f-3c05-49e7-812c-403f16d8cd96" returned: 0 in 0.501s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-73175b6f-3c05-49e7-812c-403f16d8cd96" released by "_delete_snapshot" :: held 2.290s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-4edb3ff1-7ddc-4152-86c8-db757d5a0b50" released by "delete_snapshot" :: held 2.337s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:01 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Created reservations ['65f82d5e-62ce-439a-9746-5ac0a9f4947a', '7691d41b-1d02-411d-9976-d2619350ed16', 'c833b31e-52a7-428f-8cf0-45d6d777c8ff', '1cbfa3dd-e487-40a3-81bf-2bd69dda3b50'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:58:01 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Delete snapshot completed successfully. Aug 09 12:58:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-44d776e7-f9ad-41b9-8e35-301ff0e5f5eb tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-73175b6f-3c05-49e7-812c-403f16d8cd96-delete_snapshot" released by "delete_snapshot" :: held 2.599s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:02 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-4edb3ff1-7ddc-4152-86c8-db757d5a0b50-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:02 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-4edb3ff1-7ddc-4152-86c8-db757d5a0b50-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:02 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "cinder-quobyte-4edb3ff1-7ddc-4152-86c8-db757d5a0b50" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:02 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-4edb3ff1-7ddc-4152-86c8-db757d5a0b50" acquired by "delete_volume" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:02 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c58dd5-b6ef-4f5f-a7be-a72e997ab7df]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:03 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 Aug 09 12:58:03 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:03 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50" returned: 0 in 0.544s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:03 devstack sudo[107426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50 Aug 09 12:58:03 devstack sudo[107426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:03 devstack sudo[107426]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-4edb3ff1-7ddc-4152-86c8-db757d5a0b50" returned: 0 in 0.397s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-quobyte-4edb3ff1-7ddc-4152-86c8-db757d5a0b50" released by "delete_volume" :: held 1.038s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:03 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Created reservations ['449791ce-676d-406c-acb5-6cef49d8eaca', '4e4bc8e1-b826-4176-95a5-d0c9d447601c', '20619bc5-b4f4-4aeb-bcac-e65fca3b7901', 'd6f27fa9-a5b4-46a2-91a8-0131601002fa'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:58:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:04 devstack sudo[107429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:58:04 devstack sudo[107429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:04 devstack sudo[107429]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.320s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:04 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:58:04 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Deleted volume successfully. Aug 09 12:58:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-272f791e-2a68-42fd-8a25-f34b8c5edd36 tempest-CreateVolumesFromSnapshotTest-955978690 None] Lock "cinder-4edb3ff1-7ddc-4152-86c8-db757d5a0b50-delete_volume" released by "delete_volume" :: held 1.769s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:09 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=197,cinder:SELECT=182,cinder:INSERT=67,cinder:DELETE=12 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:58:09 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=156,cinder:INSERT=51,cinder:UPDATE=196,cinder:DELETE=20 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:58:09 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:58:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Flow 'volume_create_manager' (1e1db7f7-cbc0-42bc-83ba-937a9eae32b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4570de8-ee30-46c7-a1da-c58c1ac01466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4570de8-ee30-46c7-a1da-c58c1ac01466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660164743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8457243-608c-409e-a79f-b3633b888f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb380f30b464e378a48ee7571b21fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:10Z,use_quota=True,user_id='0fd820dbe5824e1da18f2a933327f057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731ee7e0-b94a-4524-9756-d3393521908b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (731ee7e0-b94a-4524-9756-d3393521908b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e3167f-4f75-48e1-8687-e2f187f1491f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17e3167f-4f75-48e1-8687-e2f187f1491f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8457243-608c-409e-a79f-b3633b888f58', 'volume_name': 'volume-c8457243-608c-409e-a79f-b3633b888f58', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c8873e-caef-494f-9df5-8c19f95a8548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9c8873e-caef-494f-9df5-8c19f95a8548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaba1bef-1597-4a17-8c1c-1e6ee4a71251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:10 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume c8457243-608c-409e-a79f-b3633b888f58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8457243-608c-409e-a79f-b3633b888f58', 'volume_size': 1} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660164743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8457243-608c-409e-a79f-b3633b888f58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb380f30b464e378a48ee7571b21fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:10Z,use_quota=True,user_id='0fd820dbe5824e1da18f2a933327f057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Creating volume c8457243-608c-409e-a79f-b3633b888f58 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:58:10 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c8457243-608c-409e-a79f-b3633b888f58 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:10 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c8457243-608c-409e-a79f-b3633b888f58 1073741824 Aug 09 12:58:10 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:10 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c8457243-608c-409e-a79f-b3633b888f58 1073741824" returned: 0 in 0.452s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c8457243-608c-409e-a79f-b3633b888f58 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:10 devstack sudo[107479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c8457243-608c-409e-a79f-b3633b888f58 Aug 09 12:58:10 devstack sudo[107479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:10 devstack sudo[107479]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c8457243-608c-409e-a79f-b3633b888f58" returned: 0 in 0.262s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eaba1bef-1597-4a17-8c1c-1e6ee4a71251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8457243-608c-409e-a79f-b3633b888f58', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954255a3-ec07-4db4-a027-70c74eb25bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:10 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume volume-c8457243-608c-409e-a79f-b3633b888f58 (c8457243-608c-409e-a79f-b3633b888f58): created successfully Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (954255a3-ec07-4db4-a027-70c74eb25bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Flow 'volume_create_manager' (1e1db7f7-cbc0-42bc-83ba-937a9eae32b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:10 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-adcacb53-17d1-4a48-b004-ed247a2071cb tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Created volume successfully. Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Flow 'volume_create_manager' (622b3c89-c4b5-45f7-a5f7-4c3c2a97bc9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d31e0b6-9df4-4656-bc0f-6ba5b8b0418d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d31e0b6-9df4-4656-bc0f-6ba5b8b0418d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141918274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4f5afe-7a26-43ed-9925-a645feece5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee26dcd395a47099f691cbcebfb20cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:11Z,use_quota=True,user_id='e84b425251504c819520f7ab21edc0d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2893df6-271c-4c36-9e36-4fb2146cc4c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2893df6-271c-4c36-9e36-4fb2146cc4c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ce9a17-cd00-42dc-bb8e-79e2117b73ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ce9a17-cd00-42dc-bb8e-79e2117b73ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a4f5afe-7a26-43ed-9925-a645feece5ed', 'volume_name': 'volume-1a4f5afe-7a26-43ed-9925-a645feece5ed', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a44e3f7-fcfb-4969-a7d1-bce2e3e4a12b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a44e3f7-fcfb-4969-a7d1-bce2e3e4a12b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2747d1f-7a52-4657-82f7-4d03a4efb0e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:10 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Volume 1a4f5afe-7a26-43ed-9925-a645feece5ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a4f5afe-7a26-43ed-9925-a645feece5ed', 'volume_size': 1} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1141918274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a4f5afe-7a26-43ed-9925-a645feece5ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee26dcd395a47099f691cbcebfb20cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:11Z,use_quota=True,user_id='e84b425251504c819520f7ab21edc0d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Creating volume 1a4f5afe-7a26-43ed-9925-a645feece5ed {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:58:10 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:58:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1a4f5afe-7a26-43ed-9925-a645feece5ed 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:11 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1a4f5afe-7a26-43ed-9925-a645feece5ed 1073741824 Aug 09 12:58:11 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:11 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1a4f5afe-7a26-43ed-9925-a645feece5ed 1073741824" returned: 0 in 0.419s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1a4f5afe-7a26-43ed-9925-a645feece5ed {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:11 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1a4f5afe-7a26-43ed-9925-a645feece5ed Aug 09 12:58:11 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:11 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1a4f5afe-7a26-43ed-9925-a645feece5ed" returned: 0 in 0.254s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:58:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2747d1f-7a52-4657-82f7-4d03a4efb0e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a4f5afe-7a26-43ed-9925-a645feece5ed', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82255654-3c09-4697-80ce-41cbb4ddce78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:11 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Volume volume-1a4f5afe-7a26-43ed-9925-a645feece5ed (1a4f5afe-7a26-43ed-9925-a645feece5ed): created successfully Aug 09 12:58:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82255654-3c09-4697-80ce-41cbb4ddce78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Flow 'volume_create_manager' (622b3c89-c4b5-45f7-a5f7-4c3c2a97bc9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-16566b0a-9d12-499b-a378-c740fc27780c tempest-ProjectReaderTests-1288775792 None] Created volume successfully. Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Acquiring lock "cinder-1a4f5afe-7a26-43ed-9925-a645feece5ed-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Lock "cinder-1a4f5afe-7a26-43ed-9925-a645feece5ed-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Acquiring lock "cinder-quobyte-1a4f5afe-7a26-43ed-9925-a645feece5ed" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Lock "cinder-quobyte-1a4f5afe-7a26-43ed-9925-a645feece5ed" acquired by "delete_volume" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eb8e87-81f8-4f2f-b648-70c7a845bab5]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1a4f5afe-7a26-43ed-9925-a645feece5ed {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:12 devstack sudo[107492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1a4f5afe-7a26-43ed-9925-a645feece5ed Aug 09 12:58:12 devstack sudo[107492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Flow 'volume_create_manager' (9280d511-e6b2-40cb-9fc2-269fc5f9a97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064150ab-8fac-4d6c-a7c0-78374f037b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064150ab-8fac-4d6c-a7c0-78374f037b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-394419387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1608827-bbf0-4430-96da-7e420485cdc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb380f30b464e378a48ee7571b21fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:12Z,use_quota=True,user_id='0fd820dbe5824e1da18f2a933327f057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf12f954-d480-46f0-ba2a-ccfa02ed73db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf12f954-d480-46f0-ba2a-ccfa02ed73db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d13670-4dfa-4c5d-84cc-665fa33248ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48d13670-4dfa-4c5d-84cc-665fa33248ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1608827-bbf0-4430-96da-7e420485cdc3', 'volume_name': 'volume-a1608827-bbf0-4430-96da-7e420485cdc3', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c873944-7d14-4197-9fa1-5c18450903c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c873944-7d14-4197-9fa1-5c18450903c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29ad076-956a-42f2-a67a-4ddb0d69f463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:12 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume a1608827-bbf0-4430-96da-7e420485cdc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1608827-bbf0-4430-96da-7e420485cdc3', 'volume_size': 1} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-394419387',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1608827-bbf0-4430-96da-7e420485cdc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb380f30b464e378a48ee7571b21fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:12Z,use_quota=True,user_id='0fd820dbe5824e1da18f2a933327f057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Creating volume a1608827-bbf0-4430-96da-7e420485cdc3 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:12 devstack sudo[107492]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:58:12 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a1608827-bbf0-4430-96da-7e420485cdc3 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1a4f5afe-7a26-43ed-9925-a645feece5ed" returned: 0 in 0.385s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1a4f5afe-7a26-43ed-9925-a645feece5ed {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:12 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a1608827-bbf0-4430-96da-7e420485cdc3 1073741824 Aug 09 12:58:12 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:12 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1a4f5afe-7a26-43ed-9925-a645feece5ed Aug 09 12:58:12 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:58:12 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Flow 'volume_create_manager' (1e08b46f-0217-4f51-bd6d-dd6e1ce5e3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f667d96f-ed3f-4cbd-9558-b0dd07fee456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1a4f5afe-7a26-43ed-9925-a645feece5ed" returned: 0 in 0.385s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f667d96f-ed3f-4cbd-9558-b0dd07fee456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288253553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3beac446-0b76-4945-909c-fa4adc51e3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb380f30b464e378a48ee7571b21fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:13Z,use_quota=True,user_id='0fd820dbe5824e1da18f2a933327f057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14c921c-e569-4e06-8bb9-ce2558deb517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c14c921c-e569-4e06-8bb9-ce2558deb517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fae0294-2b44-4e53-a87e-fe49e3151d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8fae0294-2b44-4e53-a87e-fe49e3151d7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3beac446-0b76-4945-909c-fa4adc51e3ed', 'volume_name': 'volume-3beac446-0b76-4945-909c-fa4adc51e3ed', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a11215db-ac45-4ce1-ac1f-c0701f497f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a11215db-ac45-4ce1-ac1f-c0701f497f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe1af6e-d2da-4029-8381-4d755df5b134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:13 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume 3beac446-0b76-4945-909c-fa4adc51e3ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3beac446-0b76-4945-909c-fa4adc51e3ed', 'volume_size': 1} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Lock "cinder-quobyte-1a4f5afe-7a26-43ed-9925-a645feece5ed" released by "delete_volume" :: held 0.869s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:13 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a1608827-bbf0-4430-96da-7e420485cdc3 1073741824" returned: 0 in 0.478s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a1608827-bbf0-4430-96da-7e420485cdc3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:13 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a1608827-bbf0-4430-96da-7e420485cdc3 Aug 09 12:58:13 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Created reservations ['aa9413b7-511f-4214-814b-7b01458bc123', 'c8fcdd43-bfa0-420b-838e-62e17f9c2f64', 'f4110058-5d18-4436-a6a2-f7213d588ec3', '86fadafb-8b52-429c-ae22-2568965d9806'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:13 devstack sudo[107509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:58:13 devstack sudo[107509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Flow 'volume_create_manager' (8eb9d15e-deac-4f23-820d-02b046089f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1299a0f5-abf2-4fd3-a19a-952f548b79e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:13 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1299a0f5-abf2-4fd3-a19a-952f548b79e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-956153432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc06881-774b-4488-82a5-ebcd18478a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb380f30b464e378a48ee7571b21fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:13Z,use_quota=True,user_id='0fd820dbe5824e1da18f2a933327f057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a53e5e-a646-46bf-87c6-1972cdf1fb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20a53e5e-a646-46bf-87c6-1972cdf1fb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fb1a89-2f53-4b0f-99e9-37c78f9b450a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95fb1a89-2f53-4b0f-99e9-37c78f9b450a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc06881-774b-4488-82a5-ebcd18478a7b', 'volume_name': 'volume-9fc06881-774b-4488-82a5-ebcd18478a7b', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b033a6-b9a3-4bba-b210-8ba019448121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1b033a6-b9a3-4bba-b210-8ba019448121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21361a13-9eeb-48b9-91b3-fdfe13fdbc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:13 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume 9fc06881-774b-4488-82a5-ebcd18478a7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc06881-774b-4488-82a5-ebcd18478a7b', 'volume_size': 1} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a1608827-bbf0-4430-96da-7e420485cdc3" returned: 0 in 0.376s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.440s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1288253553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3beac446-0b76-4945-909c-fa4adc51e3ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb380f30b464e378a48ee7571b21fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:13Z,use_quota=True,user_id='0fd820dbe5824e1da18f2a933327f057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Creating volume 3beac446-0b76-4945-909c-fa4adc51e3ed {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:58:13 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3beac446-0b76-4945-909c-fa4adc51e3ed 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d29ad076-956a-42f2-a67a-4ddb0d69f463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1608827-bbf0-4430-96da-7e420485cdc3', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:13 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3beac446-0b76-4945-909c-fa4adc51e3ed 1073741824 Aug 09 12:58:13 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a80d1bd-d212-4634-8ee4-83978e6ce9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:13 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume volume-a1608827-bbf0-4430-96da-7e420485cdc3 (a1608827-bbf0-4430-96da-7e420485cdc3): created successfully Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a80d1bd-d212-4634-8ee4-83978e6ce9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Flow 'volume_create_manager' (9280d511-e6b2-40cb-9fc2-269fc5f9a97e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:13 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d0243d85-e88c-4faa-a221-9333d480e1d2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Created volume successfully. Aug 09 12:58:13 devstack sudo[107509]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.543s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:58:13 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Deleted volume successfully. Aug 09 12:58:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1322c5fc-afec-479f-9157-d84a59296ec1 tempest-ProjectReaderTests-1288775792 None] Lock "cinder-1a4f5afe-7a26-43ed-9925-a645feece5ed-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:14 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3beac446-0b76-4945-909c-fa4adc51e3ed 1073741824" returned: 0 in 0.563s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3beac446-0b76-4945-909c-fa4adc51e3ed {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:14 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3beac446-0b76-4945-909c-fa4adc51e3ed Aug 09 12:58:14 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Flow 'volume_create_manager' (3b46b1cc-63fc-4436-ad9f-a9eb38dca2f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb0f409-ef8d-4643-be6a-bc98d4fc8776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ecb0f409-ef8d-4643-be6a-bc98d4fc8776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-473056324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a671c2-ebe8-43af-9219-9941e6cf7e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb380f30b464e378a48ee7571b21fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:14Z,use_quota=True,user_id='0fd820dbe5824e1da18f2a933327f057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4713283b-8a0c-49e5-b28a-a218086a65f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4713283b-8a0c-49e5-b28a-a218086a65f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31676003-bcf2-4696-838f-6951a8e92b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31676003-bcf2-4696-838f-6951a8e92b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8a671c2-ebe8-43af-9219-9941e6cf7e9c', 'volume_name': 'volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a08022-6dd6-4451-bc25-d1fcd937ffa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52a08022-6dd6-4451-bc25-d1fcd937ffa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d6682d-4915-4fe8-a61d-030d8e17e3db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume b8a671c2-ebe8-43af-9219-9941e6cf7e9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c', 'volume_size': 1} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Flow 'volume_create_manager' (6a188349-dff3-4494-a2ba-cbc72020eed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a93e686-7cc6-4113-b755-f8cdd3ed3b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a93e686-7cc6-4113-b755-f8cdd3ed3b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108015399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f874ae8-2903-475d-90c0-c61649f7c198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee26dcd395a47099f691cbcebfb20cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:14Z,use_quota=True,user_id='e84b425251504c819520f7ab21edc0d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77fbb094-785b-45bd-bc0c-dbd74a680938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77fbb094-785b-45bd-bc0c-dbd74a680938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd7270a-767d-49d0-940f-8c66e457ed17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6fd7270a-767d-49d0-940f-8c66e457ed17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f874ae8-2903-475d-90c0-c61649f7c198', 'volume_name': 'volume-6f874ae8-2903-475d-90c0-c61649f7c198', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bcf293-ca6f-4d48-9b19-b943bae1c217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3bcf293-ca6f-4d48-9b19-b943bae1c217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ded242-ba22-408c-aa8c-fa7df71b1fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Volume 6f874ae8-2903-475d-90c0-c61649f7c198: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f874ae8-2903-475d-90c0-c61649f7c198', 'volume_size': 1} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:14 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3beac446-0b76-4945-909c-fa4adc51e3ed" returned: 0 in 0.258s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.882s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-956153432',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc06881-774b-4488-82a5-ebcd18478a7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb380f30b464e378a48ee7571b21fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:13Z,use_quota=True,user_id='0fd820dbe5824e1da18f2a933327f057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Creating volume 9fc06881-774b-4488-82a5-ebcd18478a7b {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:58:14 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fc06881-774b-4488-82a5-ebcd18478a7b 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:58:14 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fc06881-774b-4488-82a5-ebcd18478a7b 1073741824 Aug 09 12:58:14 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Flow 'volume_create_manager' (0385ae5b-9176-4e50-9f90-4bf291f12486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a536040b-64c6-424b-9aef-26743572b706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfe1af6e-d2da-4029-8381-4d755df5b134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3beac446-0b76-4945-909c-fa4adc51e3ed', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad36d38-20fb-4cf8-9516-db86daaf4147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a536040b-64c6-424b-9aef-26743572b706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575119776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7959253d-768e-4c9b-b9ed-8c6272ddfbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb380f30b464e378a48ee7571b21fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:14Z,use_quota=True,user_id='0fd820dbe5824e1da18f2a933327f057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f36962-dbfd-4446-9441-014f88a73156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f36962-dbfd-4446-9441-014f88a73156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5859a3-5e00-4c06-b10e-4b763891f369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a5859a3-5e00-4c06-b10e-4b763891f369) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7959253d-768e-4c9b-b9ed-8c6272ddfbcd', 'volume_name': 'volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f58fad-28a4-4799-b092-6e1d5de6f507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41f58fad-28a4-4799-b092-6e1d5de6f507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cf5dfd-5ef2-4d1d-b04f-3d7452dff0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:14 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume 7959253d-768e-4c9b-b9ed-8c6272ddfbcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd', 'volume_size': 1} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:14 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume volume-3beac446-0b76-4945-909c-fa4adc51e3ed (3beac446-0b76-4945-909c-fa4adc51e3ed): created successfully Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ad36d38-20fb-4cf8-9516-db86daaf4147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Flow 'volume_create_manager' (1e08b46f-0217-4f51-bd6d-dd6e1ce5e3ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:14 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-59145412-f36d-4e65-8bc3-ca240a77921b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Created volume successfully. Aug 09 12:58:14 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fc06881-774b-4488-82a5-ebcd18478a7b 1073741824" returned: 0 in 0.415s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fc06881-774b-4488-82a5-ebcd18478a7b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:14 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fc06881-774b-4488-82a5-ebcd18478a7b Aug 09 12:58:14 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:15 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fc06881-774b-4488-82a5-ebcd18478a7b" returned: 0 in 0.246s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] <== create_volume: return (699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.840s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-473056324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8a671c2-ebe8-43af-9219-9941e6cf7e9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb380f30b464e378a48ee7571b21fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:14Z,use_quota=True,user_id='0fd820dbe5824e1da18f2a933327f057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Creating volume b8a671c2-ebe8-43af-9219-9941e6cf7e9c {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:58:15 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21361a13-9eeb-48b9-91b3-fdfe13fdbc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc06881-774b-4488-82a5-ebcd18478a7b', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f086ab74-28a1-4ab8-8e9b-2da13e85f5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:15 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c 1073741824 Aug 09 12:58:15 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:15 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume volume-9fc06881-774b-4488-82a5-ebcd18478a7b (9fc06881-774b-4488-82a5-ebcd18478a7b): created successfully Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f086ab74-28a1-4ab8-8e9b-2da13e85f5c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Flow 'volume_create_manager' (8eb9d15e-deac-4f23-820d-02b046089f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:15 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-6e8191cc-5745-4dd6-97e8-f950f9a809fc tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Created volume successfully. Aug 09 12:58:15 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c 1073741824" returned: 0 in 0.422s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:15 devstack sudo[107541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c Aug 09 12:58:15 devstack sudo[107541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:15 devstack sudo[107541]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c" returned: 0 in 0.251s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.435s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-108015399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f874ae8-2903-475d-90c0-c61649f7c198,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee26dcd395a47099f691cbcebfb20cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:14Z,use_quota=True,user_id='e84b425251504c819520f7ab21edc0d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Creating volume 6f874ae8-2903-475d-90c0-c61649f7c198 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:58:15 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6f874ae8-2903-475d-90c0-c61649f7c198 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95d6682d-4915-4fe8-a61d-030d8e17e3db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:15 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6f874ae8-2903-475d-90c0-c61649f7c198 1073741824 Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f135551-d98e-47f7-931d-dbb50128b8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:15 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:15 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c (b8a671c2-ebe8-43af-9219-9941e6cf7e9c): created successfully Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f135551-d98e-47f7-931d-dbb50128b8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Flow 'volume_create_manager' (3b46b1cc-63fc-4436-ad9f-a9eb38dca2f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:15 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e74a3b8a-5a66-4d1b-bbad-ea4a14268d6d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Created volume successfully. Aug 09 12:58:16 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6f874ae8-2903-475d-90c0-c61649f7c198 1073741824" returned: 0 in 0.501s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6f874ae8-2903-475d-90c0-c61649f7c198 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:16 devstack sudo[107550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6f874ae8-2903-475d-90c0-c61649f7c198 Aug 09 12:58:16 devstack sudo[107550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:16 devstack sudo[107550]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6f874ae8-2903-475d-90c0-c61649f7c198" returned: 0 in 0.268s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.130s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1575119776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7959253d-768e-4c9b-b9ed-8c6272ddfbcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afb380f30b464e378a48ee7571b21fb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:14Z,use_quota=True,user_id='0fd820dbe5824e1da18f2a933327f057',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Creating volume 7959253d-768e-4c9b-b9ed-8c6272ddfbcd {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:58:16 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98ded242-ba22-408c-aa8c-fa7df71b1fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f874ae8-2903-475d-90c0-c61649f7c198', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:16 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd 1073741824 Aug 09 12:58:16 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97b577e-edd0-46fd-8237-692d0fbb4801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:16 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Volume volume-6f874ae8-2903-475d-90c0-c61649f7c198 (6f874ae8-2903-475d-90c0-c61649f7c198): created successfully Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b97b577e-edd0-46fd-8237-692d0fbb4801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Flow 'volume_create_manager' (6a188349-dff3-4494-a2ba-cbc72020eed2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-674e7041-add9-46aa-ba44-0a0627808169 tempest-ProjectReaderTests-1288775792 None] Created volume successfully. Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Acquiring lock "cinder-6f874ae8-2903-475d-90c0-c61649f7c198-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Lock "cinder-6f874ae8-2903-475d-90c0-c61649f7c198-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:17 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd 1073741824" returned: 0 in 0.473s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Acquiring lock "cinder-quobyte-6f874ae8-2903-475d-90c0-c61649f7c198" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Lock "cinder-quobyte-6f874ae8-2903-475d-90c0-c61649f7c198" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[aebc039a-0fd5-4e75-a785-280bad5c1de3]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6f874ae8-2903-475d-90c0-c61649f7c198 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:17 devstack sudo[107564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd Aug 09 12:58:17 devstack sudo[107564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:17 devstack sudo[107563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6f874ae8-2903-475d-90c0-c61649f7c198 Aug 09 12:58:17 devstack sudo[107563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:17 devstack sudo[107564]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd" returned: 0 in 0.282s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65cf5dfd-5ef2-4d1d-b04f-3d7452dff0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09d0111-bd74-44b3-b2a1-c136b2199254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:17 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Volume volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd (7959253d-768e-4c9b-b9ed-8c6272ddfbcd): created successfully Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f09d0111-bd74-44b3-b2a1-c136b2199254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Flow 'volume_create_manager' (0385ae5b-9176-4e50-9f90-4bf291f12486) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:17 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-6b869d63-53d0-4c6a-a395-7433a47d0d93 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Created volume successfully. Aug 09 12:58:17 devstack sudo[107563]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6f874ae8-2903-475d-90c0-c61649f7c198" returned: 0 in 0.437s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6f874ae8-2903-475d-90c0-c61649f7c198 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:17 devstack sudo[107571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6f874ae8-2903-475d-90c0-c61649f7c198 Aug 09 12:58:17 devstack sudo[107571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:17 devstack sudo[107571]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6f874ae8-2903-475d-90c0-c61649f7c198" returned: 0 in 0.249s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Lock "cinder-quobyte-6f874ae8-2903-475d-90c0-c61649f7c198" released by "delete_volume" :: held 0.732s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:17 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Created reservations ['773d0a83-1bed-4a87-af66-f79615d22165', '107729b1-1950-4842-bafc-fc5664d660f3', '6b34e74e-cc42-4446-b7f4-f59ee22b4c1c', 'c2ddd7d6-479a-4a8b-8379-515ee1902f41'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:18 devstack sudo[107574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:58:18 devstack sudo[107574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:18 devstack sudo[107574]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.250s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:58:18 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Deleted volume successfully. Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-dc3ba829-65f8-4a1a-9975-282196a95601 tempest-ProjectReaderTests-1288775792 None] Lock "cinder-6f874ae8-2903-475d-90c0-c61649f7c198-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "cinder-7959253d-768e-4c9b-b9ed-8c6272ddfbcd-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-7959253d-768e-4c9b-b9ed-8c6272ddfbcd-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "cinder-quobyte-7959253d-768e-4c9b-b9ed-8c6272ddfbcd" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-quobyte-7959253d-768e-4c9b-b9ed-8c6272ddfbcd" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e983f6f-ec03-4e19-9597-8f5836d33a32]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Flow 'volume_create_manager' (1b3bbe99-8769-492f-9ec5-e9e524082c46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d57fac-6786-4ad2-b4d8-d1e66374cc3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0d57fac-6786-4ad2-b4d8-d1e66374cc3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671228799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f183cf33-c651-4561-8b4d-d7344ac04ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee26dcd395a47099f691cbcebfb20cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:19Z,use_quota=True,user_id='e84b425251504c819520f7ab21edc0d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd4addc7-68d9-4f21-859e-9b875bce8ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd4addc7-68d9-4f21-859e-9b875bce8ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e922e2-8a6a-4684-8471-a72f7e07f354) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35e922e2-8a6a-4684-8471-a72f7e07f354) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f183cf33-c651-4561-8b4d-d7344ac04ec7', 'volume_name': 'volume-f183cf33-c651-4561-8b4d-d7344ac04ec7', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b2e92d-8f5f-40ab-9f0b-244684101fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54b2e92d-8f5f-40ab-9f0b-244684101fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (336b9406-56f5-46ad-80dc-f867a496efbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:18 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Volume f183cf33-c651-4561-8b4d-d7344ac04ec7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f183cf33-c651-4561-8b4d-d7344ac04ec7', 'volume_size': 1} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-671228799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f183cf33-c651-4561-8b4d-d7344ac04ec7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee26dcd395a47099f691cbcebfb20cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:19Z,use_quota=True,user_id='e84b425251504c819520f7ab21edc0d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Creating volume f183cf33-c651-4561-8b4d-d7344ac04ec7 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:18 devstack sudo[107577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:58:18 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:58:18 devstack sudo[107577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f183cf33-c651-4561-8b4d-d7344ac04ec7 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:18 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f183cf33-c651-4561-8b4d-d7344ac04ec7 1073741824 Aug 09 12:58:18 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:19 devstack sudo[107577]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd" returned: 0 in 0.398s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:19 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd Aug 09 12:58:19 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:19 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f183cf33-c651-4561-8b4d-d7344ac04ec7 1073741824" returned: 0 in 0.492s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f183cf33-c651-4561-8b4d-d7344ac04ec7 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:19 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f183cf33-c651-4561-8b4d-d7344ac04ec7 Aug 09 12:58:19 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:19 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7959253d-768e-4c9b-b9ed-8c6272ddfbcd" returned: 0 in 0.286s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-quobyte-7959253d-768e-4c9b-b9ed-8c6272ddfbcd" released by "delete_volume" :: held 0.732s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Created reservations ['99e6d429-6118-4b53-93c6-dd1531da354d', '5343f355-e874-4a12-a0ae-c0f61298c7b8', '7ceae8b6-7299-4180-bbc0-08e421d102dd', '08513b2c-3e50-46de-a25f-d8fecc172610'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:19 devstack sudo[107601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:58:19 devstack sudo[107601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:19 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f183cf33-c651-4561-8b4d-d7344ac04ec7" returned: 0 in 0.354s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (336b9406-56f5-46ad-80dc-f867a496efbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f183cf33-c651-4561-8b4d-d7344ac04ec7', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23017db2-3f18-45db-bfd6-14f85c75e2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:19 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Volume volume-f183cf33-c651-4561-8b4d-d7344ac04ec7 (f183cf33-c651-4561-8b4d-d7344ac04ec7): created successfully Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23017db2-3f18-45db-bfd6-14f85c75e2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Flow 'volume_create_manager' (1b3bbe99-8769-492f-9ec5-e9e524082c46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:19 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-92ef923f-24ba-4b54-a6c5-69f82e40d7b9 tempest-ProjectReaderTests-1288775792 None] Created volume successfully. Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "cinder-b8a671c2-ebe8-43af-9219-9941e6cf7e9c-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-b8a671c2-ebe8-43af-9219-9941e6cf7e9c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:19 devstack sudo[107601]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.309s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "cinder-quobyte-b8a671c2-ebe8-43af-9219-9941e6cf7e9c" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:19 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Deleted volume successfully. Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-quobyte-b8a671c2-ebe8-43af-9219-9941e6cf7e9c" acquired by "delete_volume" :: waited 0.025s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d6328afb-6e45-4388-a3c4-856fd6f3922c tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-7959253d-768e-4c9b-b9ed-8c6272ddfbcd-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[11155880-54af-4b60-8817-f4ca912b7c1d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:20 devstack sudo[107608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c Aug 09 12:58:20 devstack sudo[107608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:20 devstack sudo[107608]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c" returned: 0 in 0.394s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:20 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c Aug 09 12:58:20 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:20 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-b8a671c2-ebe8-43af-9219-9941e6cf7e9c" returned: 0 in 0.260s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-quobyte-b8a671c2-ebe8-43af-9219-9941e6cf7e9c" released by "delete_volume" :: held 0.696s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Created reservations ['fd03c134-8e43-4c04-ad80-259b0b5174b4', '30adb6e5-b5e4-420b-b7e4-a48294f3bdf4', 'dde33450-75b1-4804-9f2c-884a61986711', '0f342554-d31f-41d2-830f-4e51cc2cd8ac'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:20 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:58:20 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Acquiring lock "cinder-f183cf33-c651-4561-8b4d-d7344ac04ec7-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Lock "cinder-f183cf33-c651-4561-8b4d-d7344ac04ec7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Acquiring lock "cinder-quobyte-f183cf33-c651-4561-8b4d-d7344ac04ec7" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Lock "cinder-quobyte-f183cf33-c651-4561-8b4d-d7344ac04ec7" acquired by "delete_volume" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b31739c-5975-48ea-adb8-0a2b87b4ff31]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f183cf33-c651-4561-8b4d-d7344ac04ec7 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "cinder-9fc06881-774b-4488-82a5-ebcd18478a7b-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:21 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-9fc06881-774b-4488-82a5-ebcd18478a7b-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.347s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:58:21 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Deleted volume successfully. Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "cinder-quobyte-9fc06881-774b-4488-82a5-ebcd18478a7b" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-684587b3-8043-4497-a93e-0dc20ba16b7b tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-b8a671c2-ebe8-43af-9219-9941e6cf7e9c-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-quobyte-9fc06881-774b-4488-82a5-ebcd18478a7b" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:21 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f183cf33-c651-4561-8b4d-d7344ac04ec7 Aug 09 12:58:21 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[92616110-409e-4860-bb77-6429b4d1b88e]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fc06881-774b-4488-82a5-ebcd18478a7b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:21 devstack sudo[107626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fc06881-774b-4488-82a5-ebcd18478a7b Aug 09 12:58:21 devstack sudo[107626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:21 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f183cf33-c651-4561-8b4d-d7344ac04ec7" returned: 0 in 0.544s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f183cf33-c651-4561-8b4d-d7344ac04ec7 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:21 devstack sudo[107633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f183cf33-c651-4561-8b4d-d7344ac04ec7 Aug 09 12:58:21 devstack sudo[107633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:21 devstack sudo[107626]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fc06881-774b-4488-82a5-ebcd18478a7b" returned: 0 in 0.565s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fc06881-774b-4488-82a5-ebcd18478a7b {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:21 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fc06881-774b-4488-82a5-ebcd18478a7b Aug 09 12:58:21 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:21 devstack sudo[107633]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f183cf33-c651-4561-8b4d-d7344ac04ec7" returned: 0 in 0.468s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Lock "cinder-quobyte-f183cf33-c651-4561-8b4d-d7344ac04ec7" released by "delete_volume" :: held 1.085s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-44c52fb9-9517-43d5-bf54-cd2ba51988e4 req-f31d2a4a-eaf0-4600-8303-5662571f9dbc tempest-TestShelveInstance-344820939 None] Terminate volume connection completed successfully. Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-44c52fb9-9517-43d5-bf54-cd2ba51988e4 req-f31d2a4a-eaf0-4600-8303-5662571f9dbc tempest-TestShelveInstance-344820939 None] Deleting attachment 9bcb6136-af9f-4d4d-b106-5a4c8a147999. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Created reservations ['22052e77-888e-4590-875a-5311087a22e6', '02f0c04a-f84e-4d66-9bdd-b0f684213841', '1d57370d-99dd-45f5-9132-857b53f36482', '70e6b4ff-0e86-4c0d-8f40-b87958aeba36'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:58:22 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9fc06881-774b-4488-82a5-ebcd18478a7b" returned: 0 in 0.296s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-quobyte-9fc06881-774b-4488-82a5-ebcd18478a7b" released by "delete_volume" :: held 0.952s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Created reservations ['38163eea-b671-4b04-9cd4-4e16eb8b632b', '471e651e-9b65-41f5-8b81-8ce07bf13be1', 'eb902e18-dc45-4e00-8fcc-90dbd9f2e2cf', '340068f2-105a-4cb8-bad4-7ea82b1a2cb5'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:58:22 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:58:22 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:22 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:58:22 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:22 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.388s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:58:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Deleted volume successfully. Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-32c6d2f4-f141-45e4-bbed-1f47929e09de tempest-ProjectReaderTests-1288775792 None] Lock "cinder-f183cf33-c651-4561-8b4d-d7344ac04ec7-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:22 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.358s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:58:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Deleted volume successfully. Aug 09 12:58:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-08b8e94a-4491-4261-9cfb-41c48bc722a2 tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-9fc06881-774b-4488-82a5-ebcd18478a7b-delete_volume" released by "delete_volume" :: held 1.635s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "cinder-3beac446-0b76-4945-909c-fa4adc51e3ed-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-3beac446-0b76-4945-909c-fa4adc51e3ed-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "cinder-quobyte-3beac446-0b76-4945-909c-fa4adc51e3ed" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-quobyte-3beac446-0b76-4945-909c-fa4adc51e3ed" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c86fd4b-e00a-41f7-9cc7-ed20e0369a79]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3beac446-0b76-4945-909c-fa4adc51e3ed {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:23 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3beac446-0b76-4945-909c-fa4adc51e3ed Aug 09 12:58:23 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Flow 'volume_create_manager' (890129ea-29ac-4bd8-9927-e95b2abc0592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a1177e-e495-4423-9407-af544c757238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9a1177e-e495-4423-9407-af544c757238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923505200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f3faa0-6c68-44e4-9e97-cca261b3264d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee26dcd395a47099f691cbcebfb20cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:24Z,use_quota=True,user_id='e84b425251504c819520f7ab21edc0d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6a6e5b-afee-4c91-8b6a-d381c6c45081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6a6e5b-afee-4c91-8b6a-d381c6c45081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c689587a-9094-47cb-9a3c-999a2b8d179f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c689587a-9094-47cb-9a3c-999a2b8d179f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3f3faa0-6c68-44e4-9e97-cca261b3264d', 'volume_name': 'volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb85a9d3-04a0-466e-83e3-d7fede9b7f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb85a9d3-04a0-466e-83e3-d7fede9b7f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ece845d-ca04-48ab-931d-3e7745ba4de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:23 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Volume d3f3faa0-6c68-44e4-9e97-cca261b3264d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d', 'volume_size': 1} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1923505200',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3f3faa0-6c68-44e4-9e97-cca261b3264d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ee26dcd395a47099f691cbcebfb20cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:24Z,use_quota=True,user_id='e84b425251504c819520f7ab21edc0d3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Creating volume d3f3faa0-6c68-44e4-9e97-cca261b3264d {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:58:23 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:23 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d 1073741824 Aug 09 12:58:23 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:23 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3beac446-0b76-4945-909c-fa4adc51e3ed" returned: 0 in 0.403s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3beac446-0b76-4945-909c-fa4adc51e3ed {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:23 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3beac446-0b76-4945-909c-fa4adc51e3ed Aug 09 12:58:23 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:24 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3beac446-0b76-4945-909c-fa4adc51e3ed" returned: 0 in 0.293s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-quobyte-3beac446-0b76-4945-909c-fa4adc51e3ed" released by "delete_volume" :: held 0.738s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:24 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d 1073741824" returned: 0 in 0.481s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Created reservations ['4a0f002e-8b9d-4170-a81b-25f37635be70', '6f130d41-0829-4381-a075-f5ff97034749', 'd82359fd-93eb-4e80-8d4e-b9a97a87fe8a', '1ed66f83-bc80-4bd3-a7cf-f0308061dde7'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:58:24 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d Aug 09 12:58:24 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:24 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:58:24 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "cinder-a1608827-bbf0-4430-96da-7e420485cdc3-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:24 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d" returned: 0 in 0.365s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-a1608827-bbf0-4430-96da-7e420485cdc3-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ece845d-ca04-48ab-931d-3e7745ba4de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1336a0bc-2400-4712-aacd-02b32a8d8bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:24 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Volume volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d (d3f3faa0-6c68-44e4-9e97-cca261b3264d): created successfully Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1336a0bc-2400-4712-aacd-02b32a8d8bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Flow 'volume_create_manager' (890129ea-29ac-4bd8-9927-e95b2abc0592) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:24 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d1e78ff0-ba29-498e-936c-3c9b934408ca tempest-ProjectReaderTests-1288775792 None] Created volume successfully. Aug 09 12:58:24 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "cinder-quobyte-a1608827-bbf0-4430-96da-7e420485cdc3" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.346s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:58:24 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Deleted volume successfully. Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-quobyte-a1608827-bbf0-4430-96da-7e420485cdc3" acquired by "delete_volume" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7ecfeff5-055f-447c-a7ff-77c7ece9248d tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-3beac446-0b76-4945-909c-fa4adc51e3ed-delete_volume" released by "delete_volume" :: held 1.381s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4aa2e1-6cc2-467d-b774-c147bd07a9f6]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a1608827-bbf0-4430-96da-7e420485cdc3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:24 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a1608827-bbf0-4430-96da-7e420485cdc3 Aug 09 12:58:24 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:25 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a1608827-bbf0-4430-96da-7e420485cdc3" returned: 0 in 0.369s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a1608827-bbf0-4430-96da-7e420485cdc3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:25 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a1608827-bbf0-4430-96da-7e420485cdc3 Aug 09 12:58:25 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:25 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a1608827-bbf0-4430-96da-7e420485cdc3" returned: 0 in 0.272s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-quobyte-a1608827-bbf0-4430-96da-7e420485cdc3" released by "delete_volume" :: held 0.695s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Created reservations ['06f039c7-b1fc-462c-883d-fde97d26db69', '923c96f4-3ca6-4385-8bd8-7bfb5ab3af8c', '8b389c10-b28d-4e92-8109-a940dcb458e3', 'fbf86510-4c0b-4054-935c-743ea9f44bac'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:25 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:58:25 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-87638bfe-7e13-403b-8245-3163b4dd4b81 req-85ad0251-e45f-4998-9749-cc4be65c3104 tempest-TestShelveInstance-344820939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-87638bfe-7e13-403b-8245-3163b4dd4b81 req-85ad0251-e45f-4998-9749-cc4be65c3104 tempest-TestShelveInstance-344820939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-87638bfe-7e13-403b-8245-3163b4dd4b81 req-85ad0251-e45f-4998-9749-cc4be65c3104 tempest-TestShelveInstance-344820939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Acquiring lock "cinder-d3f3faa0-6c68-44e4-9e97-cca261b3264d-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Lock "cinder-d3f3faa0-6c68-44e4-9e97-cca261b3264d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-87638bfe-7e13-403b-8245-3163b4dd4b81 req-85ad0251-e45f-4998-9749-cc4be65c3104 tempest-TestShelveInstance-344820939 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622', 'name': 'volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c9576f39-278c-4a0e-82dd-a05cf85ba1be', 'enforce_multipath': True} {{(pid=89309) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Aug 09 12:58:25 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.306s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:58:25 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Deleted volume successfully. Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "cinder-c8457243-608c-409e-a79f-b3633b888f58-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Acquiring lock "cinder-quobyte-d3f3faa0-6c68-44e4-9e97-cca261b3264d" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2b1e412f-c0dc-4559-ad6e-84abdbf532fd tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-a1608827-bbf0-4430-96da-7e420485cdc3-delete_volume" released by "delete_volume" :: held 1.303s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Lock "cinder-quobyte-d3f3faa0-6c68-44e4-9e97-cca261b3264d" acquired by "delete_volume" :: waited 0.032s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-c8457243-608c-409e-a79f-b3633b888f58-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[83d2329d-cb6d-4020-be1a-31dbb5a69d42]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "cinder-quobyte-c8457243-608c-409e-a79f-b3633b888f58" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:26 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-87638bfe-7e13-403b-8245-3163b4dd4b81 req-85ad0251-e45f-4998-9749-cc4be65c3104 tempest-TestShelveInstance-344820939 None] attachment_update completed successfully. Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-quobyte-c8457243-608c-409e-a79f-b3633b888f58" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a9ca58-e3a4-4a63-8efd-e0ac2cb37490]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c8457243-608c-409e-a79f-b3633b888f58 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:26 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d Aug 09 12:58:26 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:26 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c8457243-608c-409e-a79f-b3633b888f58 Aug 09 12:58:26 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:26 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d" returned: 0 in 0.438s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:26 devstack sudo[107718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d Aug 09 12:58:26 devstack sudo[107718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:26 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c8457243-608c-409e-a79f-b3633b888f58" returned: 0 in 0.414s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c8457243-608c-409e-a79f-b3633b888f58 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:26 devstack sudo[107722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c8457243-608c-409e-a79f-b3633b888f58 Aug 09 12:58:26 devstack sudo[107722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:26 devstack sudo[107718]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d3f3faa0-6c68-44e4-9e97-cca261b3264d" returned: 0 in 0.277s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Lock "cinder-quobyte-d3f3faa0-6c68-44e4-9e97-cca261b3264d" released by "delete_volume" :: held 0.779s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Created reservations ['0c06bee6-dae5-47f4-aeb5-f398a5a0dbf5', 'f41a501b-1aa1-43d7-bc09-16b78260faaa', '8e92871b-43c6-49b0-833b-4b889f98fbd0', '34f31ec5-9d47-450e-869f-02848ba1884d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:58:26 devstack sudo[107722]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-c8457243-608c-409e-a79f-b3633b888f58" returned: 0 in 0.299s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-quobyte-c8457243-608c-409e-a79f-b3633b888f58" released by "delete_volume" :: held 0.773s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Created reservations ['6a3b84aa-fcea-4bc2-80a3-a68bd2457bd5', 'ff13ac40-3a3c-46bd-86ec-f40f929ee940', '17d77066-dc24-45af-b2d2-e64afff1f51e', 'ae879f0f-3dcb-4b9c-a483-b5998195dc33'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:58:26 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:58:26 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:27 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:58:27 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:27 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.410s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:27 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:58:27 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Deleted volume successfully. Aug 09 12:58:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-15757ceb-a483-44ae-bbbd-10566ae128de tempest-ProjectReaderTests-1288775792 None] Lock "cinder-d3f3faa0-6c68-44e4-9e97-cca261b3264d-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:27 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.422s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:27 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:58:27 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Deleted volume successfully. Aug 09 12:58:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-db72c80a-293e-4cf0-af8c-1bb4acb1bd6f tempest-CreateVolumesFromSourceVolumeTest-1648053809 None] Lock "cinder-c8457243-608c-409e-a79f-b3633b888f58-delete_volume" released by "delete_volume" :: held 1.516s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:58:36 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=77,cinder:INSERT=27,cinder:UPDATE=104,cinder:DELETE=10 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:58:37 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=118,cinder:SELECT=77,cinder:DELETE=10,cinder:INSERT=23 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Flow 'volume_create_manager' (49130f7a-9911-46b3-a97d-7ef7a593642a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbcca7d-c626-41ad-b318-462ee5c7bc10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bbcca7d-c626-41ad-b318-462ee5c7bc10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1092208951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d9b559-fd2a-4c0a-840f-741bfdc6352a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34ffc350b1e41449ca93f8de8f3fc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:53Z,use_quota=True,user_id='33b423ff17f44b08b37cda38ce89de7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45221285-d551-4c22-8b0d-18c18fb70ac7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45221285-d551-4c22-8b0d-18c18fb70ac7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5523b23-a6bd-45bd-976c-20f10c76cc6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5523b23-a6bd-45bd-976c-20f10c76cc6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54d9b559-fd2a-4c0a-840f-741bfdc6352a', 'volume_name': 'volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bd4954-dd6f-48a1-8e2c-cefeceb06b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6bd4954-dd6f-48a1-8e2c-cefeceb06b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63495955-40e6-4b95-9eac-b5e04f9ba731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:52 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Volume 54d9b559-fd2a-4c0a-840f-741bfdc6352a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a', 'volume_size': 1} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1092208951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54d9b559-fd2a-4c0a-840f-741bfdc6352a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34ffc350b1e41449ca93f8de8f3fc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:53Z,use_quota=True,user_id='33b423ff17f44b08b37cda38ce89de7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Creating volume 54d9b559-fd2a-4c0a-840f-741bfdc6352a {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:58:52 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:58:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:52 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a 1073741824 Aug 09 12:58:52 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:53 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a 1073741824" returned: 0 in 0.412s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:53 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a Aug 09 12:58:53 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:53 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a" returned: 0 in 0.243s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] <== create_volume: return (696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.699s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63495955-40e6-4b95-9eac-b5e04f9ba731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed746ed9-b98c-4763-8b43-aa0d29cf371d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:53 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Volume volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a (54d9b559-fd2a-4c0a-840f-741bfdc6352a): created successfully Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed746ed9-b98c-4763-8b43-aa0d29cf371d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Flow 'volume_create_manager' (49130f7a-9911-46b3-a97d-7ef7a593642a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:53 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-136ec26a-e39d-433e-85c5-63fcaed28f98 tempest-SnapshotDependencyTests-947042169 None] Created volume successfully. Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] Creating offline snapshot 1ccea943-a51c-48e1-a6fc-d775dffab62a of volume 54d9b559-fd2a-4c0a-840f-741bfdc6352a {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[024fe336-7f99-4d7e-b22e-173a43fc9c53]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:54 devstack sudo[108288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a Aug 09 12:58:54 devstack sudo[108288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:54 devstack sudo[108288]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a" returned: 0 in 0.378s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:54 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a 1G Aug 09 12:58:54 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:54 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a 1G" returned: 0 in 0.435s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:54 devstack sudo[108299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a Aug 09 12:58:54 devstack sudo[108299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:55 devstack sudo[108299]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a" returned: 0 in 0.291s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:55 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a is being set with open permissions: ugo+rw Aug 09 12:58:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:55 devstack sudo[108304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a Aug 09 12:58:55 devstack sudo[108304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:55 devstack sudo[108304]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a" returned: 0 in 0.256s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:55 devstack sudo[108307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.info Aug 09 12:58:55 devstack sudo[108307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:55 devstack sudo[108307]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.info" returned: 0 in 0.245s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:55 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.info is being set with open permissions: ugo+rw Aug 09 12:58:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:55 devstack sudo[108310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.info Aug 09 12:58:55 devstack sudo[108310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:55 devstack sudo[108310]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.info" returned: 0 in 0.245s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.939s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:55 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-23be30a8-c57c-4074-896a-069373723c55 tempest-SnapshotDependencyTests-947042169 None] Create snapshot completed successfully Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Flow 'volume_create_manager' (0c358382-ef99-4078-b4cb-498dfb0ebafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0a758e-520d-445a-a063-1759fe1cf772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0a758e-520d-445a-a063-1759fe1cf772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:58:56Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46aa1474-b3f7-4309-8e97-93315cd6d271,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b34ffc350b1e41449ca93f8de8f3fc78',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:58:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1ccea943-a51c-48e1-a6fc-d775dffab62a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:58:57Z,use_quota=True,user_id='33b423ff17f44b08b37cda38ce89de7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5011cb83-314a-481d-b34a-5c26daa90474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5011cb83-314a-481d-b34a-5c26daa90474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c4d4b0-87cc-4b24-9e6e-f455f24af687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02c4d4b0-87cc-4b24-9e6e-f455f24af687) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '46aa1474-b3f7-4309-8e97-93315cd6d271', 'volume_name': 'volume-46aa1474-b3f7-4309-8e97-93315cd6d271', 'volume_size': 1, 'snapshot_id': '1ccea943-a51c-48e1-a6fc-d775dffab62a'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fdcff55-b550-4166-a70a-31aa4eb47511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fdcff55-b550-4166-a70a-31aa4eb47511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59240040-8c7d-4146-96d5-5069daac997d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:58:56 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Volume 46aa1474-b3f7-4309-8e97-93315cd6d271: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-46aa1474-b3f7-4309-8e97-93315cd6d271', 'volume_size': 1, 'snapshot_id': '1ccea943-a51c-48e1-a6fc-d775dffab62a'} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "cinder-quobyte-1ccea943-a51c-48e1-a6fc-d775dffab62a-46aa1474-b3f7-4309-8e97-93315cd6d271" by "_create_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-quobyte-1ccea943-a51c-48e1-a6fc-d775dffab62a-46aa1474-b3f7-4309-8e97-93315cd6d271" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Creating volume 46aa1474-b3f7-4309-8e97-93315cd6d271 from snapshot 1ccea943-a51c-48e1-a6fc-d775dffab62a {{(pid=89309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "cinder-quobyte-46aa1474-b3f7-4309-8e97-93315cd6d271" by "_copy_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-quobyte-46aa1474-b3f7-4309-8e97-93315cd6d271" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] snapshot: 1ccea943-a51c-48e1-a6fc-d775dffab62a, volume: 46aa1474-b3f7-4309-8e97-93315cd6d271, {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ed47445-6abb-4794-8b48-84fa295d2d6d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:56 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a Aug 09 12:58:56 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:57 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a" returned: 0 in 0.359s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ec77c4-fb83-47cc-b68b-e222513ce6de]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:57 devstack sudo[108319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a Aug 09 12:58:57 devstack sudo[108319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:57 devstack sudo[108319]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a" returned: 0 in 0.349s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Creating direct copy from snapshot {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG cinder.utils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Path /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271 not found in is_blk_device check {{(pid=89309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:57 devstack sudo[108324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271 Aug 09 12:58:57 devstack sudo[108324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:58:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:58:57 devstack sudo[108329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:58:57 devstack sudo[108329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:58:58 devstack sudo[108329]: pam_unix(sudo:session): session closed for user root Aug 09 12:58:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.343s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:58:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:58:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:58:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:58:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 12:59:01 devstack sudo[108324]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271" returned: 0 in 4.247s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:01 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a, size 1024.00 MB, duration 4.25 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:59:01 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Converted 1024.00 MB image at 241.07 MB/s Aug 09 12:59:01 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271 is being set with open permissions: ugo+rw Aug 09 12:59:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:01 devstack sudo[108341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271 Aug 09 12:59:01 devstack sudo[108341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:01 devstack sudo[108341]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271" returned: 0 in 0.245s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:01 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-quobyte-46aa1474-b3f7-4309-8e97-93315cd6d271" released by "_copy_volume_from_snapshot" :: held 5.276s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:02 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-quobyte-1ccea943-a51c-48e1-a6fc-d775dffab62a-46aa1474-b3f7-4309-8e97-93315cd6d271" released by "_create_volume_from_snapshot" :: held 5.339s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.355s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59240040-8c7d-4146-96d5-5069daac997d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46aa1474-b3f7-4309-8e97-93315cd6d271', 'volume_size': 1, 'snapshot_id': '1ccea943-a51c-48e1-a6fc-d775dffab62a'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4807cbd5-9c55-46fe-a2a3-c35f6847c421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:02 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Volume volume-46aa1474-b3f7-4309-8e97-93315cd6d271 (46aa1474-b3f7-4309-8e97-93315cd6d271): created successfully Aug 09 12:59:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4807cbd5-9c55-46fe-a2a3-c35f6847c421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:02 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Flow 'volume_create_manager' (0c358382-ef99-4078-b4cb-498dfb0ebafb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:02 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-89c99c0a-9670-4f38-9ec6-23350584dfba tempest-SnapshotDependencyTests-947042169 None] Created volume successfully. Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "cinder-1ccea943-a51c-48e1-a6fc-d775dffab62a-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-1ccea943-a51c-48e1-a6fc-d775dffab62a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "cinder-quobyte-54d9b559-fd2a-4c0a-840f-741bfdc6352a" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-quobyte-54d9b559-fd2a-4c0a-840f-741bfdc6352a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "cinder-quobyte-1ccea943-a51c-48e1-a6fc-d775dffab62a" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-quobyte-1ccea943-a51c-48e1-a6fc-d775dffab62a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Deleting offline snapshot 1ccea943-a51c-48e1-a6fc-d775dffab62a of volume 54d9b559-fd2a-4c0a-840f-741bfdc6352a {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] snapshot_file for this snap is: volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a6597c2-f200-4d68-b3d6-d262785043d0]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:03 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a Aug 09 12:59:03 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:03 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a" returned: 0 in 0.348s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[066b9c9e-bdfe-4c17-952b-c5f60fee36fa]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:03 devstack sudo[108349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a Aug 09 12:59:03 devstack sudo[108349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:04 devstack sudo[108349]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a" returned: 0 in 0.536s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:04 devstack sudo[108354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a Aug 09 12:59:04 devstack sudo[108354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:04 devstack sudo[108354]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a" returned: 0 in 0.327s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:04 devstack sudo[108359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a Aug 09 12:59:04 devstack sudo[108359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:04 devstack sudo[108359]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a.1ccea943-a51c-48e1-a6fc-d775dffab62a" returned: 0 in 0.236s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-quobyte-1ccea943-a51c-48e1-a6fc-d775dffab62a" released by "_delete_snapshot" :: held 1.543s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-quobyte-54d9b559-fd2a-4c0a-840f-741bfdc6352a" released by "delete_snapshot" :: held 1.565s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:04 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Created reservations ['81dddec0-8d01-4e0f-8a84-b7411c917980', 'bfacc6d3-50a0-4db8-b336-eac129986565', '2b816377-a817-47d2-8ab7-5d55fa0f2453', 'dfb429ba-b335-44a1-8833-a96610cfabf3'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:59:04 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Delete snapshot completed successfully. Aug 09 12:59:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e483cf4f-7f4b-4d54-9a90-b4f02dea7d97 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-1ccea943-a51c-48e1-a6fc-d775dffab62a-delete_snapshot" released by "delete_snapshot" :: held 1.694s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "cinder-54d9b559-fd2a-4c0a-840f-741bfdc6352a-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-54d9b559-fd2a-4c0a-840f-741bfdc6352a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "cinder-quobyte-54d9b559-fd2a-4c0a-840f-741bfdc6352a" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-quobyte-54d9b559-fd2a-4c0a-840f-741bfdc6352a" acquired by "delete_volume" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:05 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf6b39f-4a15-4c7f-a6b9-0ed0d5843ecd]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:05 devstack sudo[108362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a Aug 09 12:59:05 devstack sudo[108362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:05 devstack sudo[108362]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a" returned: 0 in 0.360s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:05 devstack sudo[108367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a Aug 09 12:59:05 devstack sudo[108367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:06 devstack sudo[108367]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-54d9b559-fd2a-4c0a-840f-741bfdc6352a" returned: 0 in 0.259s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-quobyte-54d9b559-fd2a-4c0a-840f-741bfdc6352a" released by "delete_volume" :: held 0.698s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Created reservations ['2b3bd0e1-2ae8-4271-ba60-3507960fe104', '5ac2eb08-a9ab-4dfb-aa99-fc66b63782ec', '1ad9f353-5b4d-4738-97f0-7bf99fc13955', 'bca2e6d5-8bfa-4546-b2ee-91403e83193a'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:06 devstack sudo[108370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:59:06 devstack sudo[108370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:06 devstack sudo[108370]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.240s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:59:06 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Deleted volume successfully. Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-30343e7d-0e3f-463c-92d3-f4c8f113aa28 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-54d9b559-fd2a-4c0a-840f-741bfdc6352a-delete_volume" released by "delete_volume" :: held 1.117s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "cinder-46aa1474-b3f7-4309-8e97-93315cd6d271-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-46aa1474-b3f7-4309-8e97-93315cd6d271-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "cinder-quobyte-46aa1474-b3f7-4309-8e97-93315cd6d271" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-quobyte-46aa1474-b3f7-4309-8e97-93315cd6d271" acquired by "delete_volume" :: waited 0.013s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4058459d-d9c5-4e12-984b-738cf2d00c6c]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:06 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271 Aug 09 12:59:06 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:07 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271" returned: 0 in 0.348s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:07 devstack sudo[108378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271 Aug 09 12:59:07 devstack sudo[108378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:07 devstack sudo[108378]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-46aa1474-b3f7-4309-8e97-93315cd6d271" returned: 0 in 0.234s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-quobyte-46aa1474-b3f7-4309-8e97-93315cd6d271" released by "delete_volume" :: held 0.623s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Created reservations ['a6a1737d-4f5a-4763-ba53-587a5562de2f', '75e3056f-e15b-42a2-8413-34dc3580f08c', 'bac2cc45-dd65-4654-bf1d-d223e6ca3d6b', '8e4a4665-4507-4b04-93ff-3068f40d9e21'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:07 devstack sudo[108381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:59:07 devstack sudo[108381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:07 devstack sudo[108381]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.239s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:59:07 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Deleted volume successfully. Aug 09 12:59:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5787b65a-c2ac-43c6-a74b-624e872726e8 tempest-SnapshotDependencyTests-947042169 None] Lock "cinder-46aa1474-b3f7-4309-8e97-93315cd6d271-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:12 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-7869466d-1193-46bd-8916-2ef043fa2eb2 tempest-TestShelveInstance-344820939 None] Terminate volume connection completed successfully. Aug 09 12:59:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-7869466d-1193-46bd-8916-2ef043fa2eb2 tempest-TestShelveInstance-344820939 None] Deleting attachment c9576f39-278c-4a0e-82dd-a05cf85ba1be. {{(pid=89309) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Aug 09 12:59:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Acquiring lock "cinder-36bc943e-8b1f-462b-8c2c-b6625bd870c5-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Lock "cinder-36bc943e-8b1f-462b-8c2c-b6625bd870c5-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Acquiring lock "cinder-quobyte-36bc943e-8b1f-462b-8c2c-b6625bd870c5" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:12 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Lock "cinder-quobyte-36bc943e-8b1f-462b-8c2c-b6625bd870c5" acquired by "delete_volume" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:12 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d26632-ae99-4a7d-814d-c47c3aa2e291]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:12 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 Aug 09 12:59:12 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:12 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5" returned: 0 in 0.421s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:12 devstack sudo[108425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5 Aug 09 12:59:12 devstack sudo[108425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:13 devstack sudo[108425]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36bc943e-8b1f-462b-8c2c-b6625bd870c5" returned: 0 in 0.259s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Lock "cinder-quobyte-36bc943e-8b1f-462b-8c2c-b6625bd870c5" released by "delete_volume" :: held 0.737s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:13 devstack cinder-volume[89309]: DEBUG cinder.quota [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Created reservations ['2c91651d-5820-4822-aaf3-f0e44d8d359b', 'bb75e407-4218-4b5c-ae8f-b9543324abad', 'e0721dcd-0edf-418e-8f55-31f38d1ba08e', 'd36db37a-333b-4e61-8fd7-63099f1f7100'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:59:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:13 devstack sudo[108428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:59:13 devstack sudo[108428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:13 devstack sudo[108428]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.319s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:13 devstack cinder-volume[89309]: DEBUG cinder.manager [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:59:13 devstack cinder-volume[89309]: INFO cinder.volume.manager [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Deleted volume successfully. Aug 09 12:59:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [req-a166396b-7d14-4d6e-bb5f-b7a6d363c744 req-f4577858-f4b4-4a90-a92f-4ddf87e2baa5 tempest-TestShelveInstance-344820939 None] Lock "cinder-36bc943e-8b1f-462b-8c2c-b6625bd870c5-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:23 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=36,cinder:UPDATE=41,cinder:DELETE=1,cinder:INSERT=11 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:59:23 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=25,cinder:INSERT=8,cinder:UPDATE=33,cinder:DELETE=5 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Flow 'volume_create_manager' (68600cdd-be14-4565-ad86-7d5f1f88c075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a1860e-4b03-4d1a-8c65-6d6b7e63dbba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1a1860e-4b03-4d1a-8c65-6d6b7e63dbba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489982170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de584664-19da-4474-a8f2-0eae67aae7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc07659a62954398a78dec6b9cbbde3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:59:25Z,use_quota=True,user_id='c60f37a81c774a4e9e5df1b55a464b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb6496d-ecc9-4769-a996-2129b1a54591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb6496d-ecc9-4769-a996-2129b1a54591) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226cc4c1-99f1-4099-bb3b-aa53a7c741b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (226cc4c1-99f1-4099-bb3b-aa53a7c741b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de584664-19da-4474-a8f2-0eae67aae7e2', 'volume_name': 'volume-de584664-19da-4474-a8f2-0eae67aae7e2', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78acde94-2c36-400a-8cc8-9344d2cf0d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78acde94-2c36-400a-8cc8-9344d2cf0d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f08ef4c-8ed2-4c0f-9012-d2c9c54bbc2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:25 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Volume de584664-19da-4474-a8f2-0eae67aae7e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de584664-19da-4474-a8f2-0eae67aae7e2', 'volume_size': 1} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1489982170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de584664-19da-4474-a8f2-0eae67aae7e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc07659a62954398a78dec6b9cbbde3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:59:25Z,use_quota=True,user_id='c60f37a81c774a4e9e5df1b55a464b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Creating volume de584664-19da-4474-a8f2-0eae67aae7e2 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:59:25 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de584664-19da-4474-a8f2-0eae67aae7e2 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:25 devstack sudo[108440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de584664-19da-4474-a8f2-0eae67aae7e2 1073741824 Aug 09 12:59:25 devstack sudo[108440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Flow 'volume_create_manager' (968cc8b2-993e-43a5-a3eb-78dbfec1ab83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ef4072-6035-4b51-bccd-0fed23129fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3ef4072-6035-4b51-bccd-0fed23129fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1173710492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de500e8-efe4-43fe-a6d4-ed7500e7040c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc07659a62954398a78dec6b9cbbde3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:59:26Z,use_quota=True,user_id='c60f37a81c774a4e9e5df1b55a464b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb220e6-512c-40b4-9830-283371e576ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bb220e6-512c-40b4-9830-283371e576ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9417a720-82b0-42f1-8c15-280079b050c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9417a720-82b0-42f1-8c15-280079b050c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9de500e8-efe4-43fe-a6d4-ed7500e7040c', 'volume_name': 'volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a429bd6-99bf-4fc9-b539-c5c9444e4a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a429bd6-99bf-4fc9-b539-c5c9444e4a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df699aed-20d5-436f-985d-edcce617e6bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:25 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Volume 9de500e8-efe4-43fe-a6d4-ed7500e7040c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c', 'volume_size': 1} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:25 devstack sudo[108440]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de584664-19da-4474-a8f2-0eae67aae7e2 1073741824" returned: 0 in 0.505s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de584664-19da-4474-a8f2-0eae67aae7e2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:25 devstack sudo[108446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de584664-19da-4474-a8f2-0eae67aae7e2 Aug 09 12:59:26 devstack sudo[108446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Flow 'volume_create_manager' (1127fee7-6312-434b-911d-854c50e21e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8811cc71-d038-4789-8788-ba0b77b021ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8811cc71-d038-4789-8788-ba0b77b021ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-674820410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5fc508-34ac-436d-ab8c-47d9c0993301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc07659a62954398a78dec6b9cbbde3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:59:26Z,use_quota=True,user_id='c60f37a81c774a4e9e5df1b55a464b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b010d8-523d-4b5a-982f-bc9f2c081537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45b010d8-523d-4b5a-982f-bc9f2c081537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774b6c9f-489e-4e9d-a00f-70fcdf469860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (774b6c9f-489e-4e9d-a00f-70fcdf469860) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b5fc508-34ac-436d-ab8c-47d9c0993301', 'volume_name': 'volume-6b5fc508-34ac-436d-ab8c-47d9c0993301', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c07f25-78b5-42fe-8436-6445c66031da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78c07f25-78b5-42fe-8436-6445c66031da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163a7c83-abbc-491f-968d-44d8ce20869c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Volume 6b5fc508-34ac-436d-ab8c-47d9c0993301: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b5fc508-34ac-436d-ab8c-47d9c0993301', 'volume_size': 1} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:26 devstack sudo[108446]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de584664-19da-4474-a8f2-0eae67aae7e2" returned: 0 in 0.276s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.834s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.490s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:59:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1173710492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9de500e8-efe4-43fe-a6d4-ed7500e7040c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc07659a62954398a78dec6b9cbbde3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:59:26Z,use_quota=True,user_id='c60f37a81c774a4e9e5df1b55a464b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Creating volume 9de500e8-efe4-43fe-a6d4-ed7500e7040c {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:59:26 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:26 devstack sudo[108449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c 1073741824 Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f08ef4c-8ed2-4c0f-9012-d2c9c54bbc2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de584664-19da-4474-a8f2-0eae67aae7e2', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack sudo[108449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd5ef76-1087-435d-b2b1-4774f75b9db9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Volume volume-de584664-19da-4474-a8f2-0eae67aae7e2 (de584664-19da-4474-a8f2-0eae67aae7e2): created successfully Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd5ef76-1087-435d-b2b1-4774f75b9db9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Flow 'volume_create_manager' (68600cdd-be14-4565-ad86-7d5f1f88c075) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:26 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-75e22d2f-d5d5-4991-bd68-f9fdb78adf61 tempest-CreateVolumesFromImageTest-943004060 None] Created volume successfully. Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Flow 'volume_create_manager' (b98b6d6b-3a55-4b8b-a926-0a26ac1900f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd63deb-f3d7-4df3-aec7-b96713a78343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdd63deb-f3d7-4df3-aec7-b96713a78343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1982481587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883279bb-3600-41f6-87c2-81c7d106d629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc07659a62954398a78dec6b9cbbde3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:59:26Z,use_quota=True,user_id='c60f37a81c774a4e9e5df1b55a464b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12506e77-c874-4d76-a738-b14d0a866598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12506e77-c874-4d76-a738-b14d0a866598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4276681-3724-4a9b-b069-8f96f971970a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a4276681-3724-4a9b-b069-8f96f971970a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '883279bb-3600-41f6-87c2-81c7d106d629', 'volume_name': 'volume-883279bb-3600-41f6-87c2-81c7d106d629', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72da65e-1bab-43f9-aea5-96e95bd454ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f72da65e-1bab-43f9-aea5-96e95bd454ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11e64dd-d7c8-4b4b-9f55-8b36cfe8cf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Volume 883279bb-3600-41f6-87c2-81c7d106d629: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-883279bb-3600-41f6-87c2-81c7d106d629', 'volume_size': 1} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:26 devstack sudo[108449]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c 1073741824" returned: 0 in 0.508s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Flow 'volume_create_manager' (328294a6-3089-4ac7-be21-041709382d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c0344d-d0ef-42af-b9ce-bf68cccdcec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87c0344d-d0ef-42af-b9ce-bf68cccdcec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-53572607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0de9f4e-d323-456e-8af9-c76d4a97a3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc07659a62954398a78dec6b9cbbde3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:59:27Z,use_quota=True,user_id='c60f37a81c774a4e9e5df1b55a464b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c45f149-3bbe-4876-91db-3f7ad7456ba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c45f149-3bbe-4876-91db-3f7ad7456ba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37e5de2-28da-4968-86a3-7d6679dbc81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a37e5de2-28da-4968-86a3-7d6679dbc81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0de9f4e-d323-456e-8af9-c76d4a97a3c6', 'volume_name': 'volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eebe407-bed9-49b6-863e-52e1ca1840eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1eebe407-bed9-49b6-863e-52e1ca1840eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77558ab0-62c9-4071-9d21-79cd6d1ea787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:26 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Volume d0de9f4e-d323-456e-8af9-c76d4a97a3c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6', 'volume_size': 1} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:26 devstack sudo[108454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c Aug 09 12:59:26 devstack sudo[108454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:27 devstack sudo[108454]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c" returned: 0 in 0.244s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.958s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-674820410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b5fc508-34ac-436d-ab8c-47d9c0993301,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc07659a62954398a78dec6b9cbbde3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:59:26Z,use_quota=True,user_id='c60f37a81c774a4e9e5df1b55a464b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Creating volume 6b5fc508-34ac-436d-ab8c-47d9c0993301 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:59:27 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6b5fc508-34ac-436d-ab8c-47d9c0993301 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df699aed-20d5-436f-985d-edcce617e6bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040e77b6-2bf5-4a34-b3a0-489e8fef2232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:27 devstack sudo[108457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6b5fc508-34ac-436d-ab8c-47d9c0993301 1073741824 Aug 09 12:59:27 devstack sudo[108457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:27 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Volume volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c (9de500e8-efe4-43fe-a6d4-ed7500e7040c): created successfully Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (040e77b6-2bf5-4a34-b3a0-489e8fef2232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Flow 'volume_create_manager' (968cc8b2-993e-43a5-a3eb-78dbfec1ab83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:27 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f927ac35-4e2c-46a5-8689-e73d9b9cbebd tempest-CreateVolumesFromImageTest-943004060 None] Created volume successfully. Aug 09 12:59:27 devstack sudo[108457]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6b5fc508-34ac-436d-ab8c-47d9c0993301 1073741824" returned: 0 in 0.420s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6b5fc508-34ac-436d-ab8c-47d9c0993301 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:27 devstack sudo[108462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6b5fc508-34ac-436d-ab8c-47d9c0993301 Aug 09 12:59:27 devstack sudo[108462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:27 devstack sudo[108462]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6b5fc508-34ac-436d-ab8c-47d9c0993301" returned: 0 in 0.253s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.316s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1982481587',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=883279bb-3600-41f6-87c2-81c7d106d629,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc07659a62954398a78dec6b9cbbde3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:59:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:59:26Z,use_quota=True,user_id='c60f37a81c774a4e9e5df1b55a464b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Creating volume 883279bb-3600-41f6-87c2-81c7d106d629 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:59:27 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-883279bb-3600-41f6-87c2-81c7d106d629 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (163a7c83-abbc-491f-968d-44d8ce20869c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b5fc508-34ac-436d-ab8c-47d9c0993301', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:27 devstack sudo[108465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-883279bb-3600-41f6-87c2-81c7d106d629 1073741824 Aug 09 12:59:27 devstack sudo[108465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ee071e-5037-4502-ba26-5d3fb3df0836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:27 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Volume volume-6b5fc508-34ac-436d-ab8c-47d9c0993301 (6b5fc508-34ac-436d-ab8c-47d9c0993301): created successfully Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ee071e-5037-4502-ba26-5d3fb3df0836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Flow 'volume_create_manager' (1127fee7-6312-434b-911d-854c50e21e72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:27 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-7eca90f4-7e9f-4e94-a924-13bf00db0c80 tempest-CreateVolumesFromImageTest-943004060 None] Created volume successfully. Aug 09 12:59:28 devstack sudo[108465]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-883279bb-3600-41f6-87c2-81c7d106d629 1073741824" returned: 0 in 0.404s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-883279bb-3600-41f6-87c2-81c7d106d629 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:28 devstack sudo[108471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-883279bb-3600-41f6-87c2-81c7d106d629 Aug 09 12:59:28 devstack sudo[108471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:28 devstack sudo[108471]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-883279bb-3600-41f6-87c2-81c7d106d629" returned: 0 in 0.260s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.704s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.675s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:59:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-53572607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0de9f4e-d323-456e-8af9-c76d4a97a3c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cc07659a62954398a78dec6b9cbbde3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:59:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:59:27Z,use_quota=True,user_id='c60f37a81c774a4e9e5df1b55a464b99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Creating volume d0de9f4e-d323-456e-8af9-c76d4a97a3c6 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:59:28 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:28 devstack sudo[108474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6 1073741824 Aug 09 12:59:28 devstack sudo[108474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e11e64dd-d7c8-4b4b-9f55-8b36cfe8cf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-883279bb-3600-41f6-87c2-81c7d106d629', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd57797e-e013-41dd-baf5-eb6394ad3e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:28 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Volume volume-883279bb-3600-41f6-87c2-81c7d106d629 (883279bb-3600-41f6-87c2-81c7d106d629): created successfully Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd57797e-e013-41dd-baf5-eb6394ad3e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Flow 'volume_create_manager' (b98b6d6b-3a55-4b8b-a926-0a26ac1900f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:28 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-af639795-36cb-460d-8454-e2d57e7174c7 tempest-CreateVolumesFromImageTest-943004060 None] Created volume successfully. Aug 09 12:59:28 devstack sudo[108474]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6 1073741824" returned: 0 in 0.425s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:29 devstack sudo[108479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6 Aug 09 12:59:29 devstack sudo[108479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:29 devstack sudo[108479]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6" returned: 0 in 0.244s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:59:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77558ab0-62c9-4071-9d21-79cd6d1ea787) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0860ac4-15fb-47dd-9c62-7a5427b592a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:29 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Volume volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6 (d0de9f4e-d323-456e-8af9-c76d4a97a3c6): created successfully Aug 09 12:59:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0860ac4-15fb-47dd-9c62-7a5427b592a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Flow 'volume_create_manager' (328294a6-3089-4ac7-be21-041709382d81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:29 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d3e88e14-8201-4ed9-849a-3255fcffcfc9 tempest-CreateVolumesFromImageTest-943004060 None] Created volume successfully. Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "cinder-d0de9f4e-d323-456e-8af9-c76d4a97a3c6-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-d0de9f4e-d323-456e-8af9-c76d4a97a3c6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "cinder-quobyte-d0de9f4e-d323-456e-8af9-c76d4a97a3c6" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-quobyte-d0de9f4e-d323-456e-8af9-c76d4a97a3c6" acquired by "delete_volume" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[cead146c-23ad-4796-9099-c92127896937]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:30 devstack sudo[108482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6 Aug 09 12:59:30 devstack sudo[108482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:30 devstack sudo[108482]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6" returned: 0 in 0.354s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:30 devstack sudo[108488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6 Aug 09 12:59:30 devstack sudo[108488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:30 devstack sudo[108488]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0de9f4e-d323-456e-8af9-c76d4a97a3c6" returned: 0 in 0.252s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-quobyte-d0de9f4e-d323-456e-8af9-c76d4a97a3c6" released by "delete_volume" :: held 0.642s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Created reservations ['a60d60eb-802e-4ab2-8cb7-4bafb9c408cc', '5ed704e8-abdc-461d-b6c0-1d05e1605d92', '19658eaa-67d3-4f19-ae73-34c6ca086e3f', 'b467b787-12c3-487d-acf3-82f26628db7b'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:31 devstack sudo[108491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:59:31 devstack sudo[108491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:31 devstack sudo[108491]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.237s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:31 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:59:31 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Deleted volume successfully. Aug 09 12:59:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-aa169dab-15f9-49fe-86a4-d71e6f1485ef tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-d0de9f4e-d323-456e-8af9-c76d4a97a3c6-delete_volume" released by "delete_volume" :: held 1.069s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "cinder-883279bb-3600-41f6-87c2-81c7d106d629-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-883279bb-3600-41f6-87c2-81c7d106d629-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "cinder-quobyte-883279bb-3600-41f6-87c2-81c7d106d629" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-quobyte-883279bb-3600-41f6-87c2-81c7d106d629" acquired by "delete_volume" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:31 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d01ea73-3530-411a-8488-eb0ad44a02b2]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-883279bb-3600-41f6-87c2-81c7d106d629 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:31 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-883279bb-3600-41f6-87c2-81c7d106d629 Aug 09 12:59:31 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:31 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-883279bb-3600-41f6-87c2-81c7d106d629" returned: 0 in 0.343s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-883279bb-3600-41f6-87c2-81c7d106d629 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:31 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-883279bb-3600-41f6-87c2-81c7d106d629 Aug 09 12:59:31 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:31 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-883279bb-3600-41f6-87c2-81c7d106d629" returned: 0 in 0.240s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:31 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-quobyte-883279bb-3600-41f6-87c2-81c7d106d629" released by "delete_volume" :: held 0.623s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Created reservations ['4ada048e-fa21-4cf6-ab24-c1a5d398a9da', 'aa2e342c-250f-45bf-a608-dc8c05ac4cee', '9d39a34d-ff02-4ba2-9232-5c304bb27654', '36389517-7147-4155-a60b-c1eda247c1af'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:32 devstack sudo[108502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:59:32 devstack sudo[108502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:32 devstack sudo[108502]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.238s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:59:32 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Deleted volume successfully. Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e1f8d555-b56a-4b2e-b9c6-479fcd21f2ae tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-883279bb-3600-41f6-87c2-81c7d106d629-delete_volume" released by "delete_volume" :: held 1.044s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "cinder-6b5fc508-34ac-436d-ab8c-47d9c0993301-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-6b5fc508-34ac-436d-ab8c-47d9c0993301-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "cinder-quobyte-6b5fc508-34ac-436d-ab8c-47d9c0993301" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-quobyte-6b5fc508-34ac-436d-ab8c-47d9c0993301" acquired by "delete_volume" :: waited 0.013s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e950a2-16ff-4492-a0eb-f83a57d987e6]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6b5fc508-34ac-436d-ab8c-47d9c0993301 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:32 devstack sudo[108505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6b5fc508-34ac-436d-ab8c-47d9c0993301 Aug 09 12:59:32 devstack sudo[108505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:32 devstack sudo[108505]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6b5fc508-34ac-436d-ab8c-47d9c0993301" returned: 0 in 0.358s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6b5fc508-34ac-436d-ab8c-47d9c0993301 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:32 devstack sudo[108510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6b5fc508-34ac-436d-ab8c-47d9c0993301 Aug 09 12:59:32 devstack sudo[108510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:33 devstack sudo[108510]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6b5fc508-34ac-436d-ab8c-47d9c0993301" returned: 0 in 0.241s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-quobyte-6b5fc508-34ac-436d-ab8c-47d9c0993301" released by "delete_volume" :: held 0.639s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Created reservations ['90ebee52-2d8d-40cc-b9e7-4d1af0f3df75', 'c6c92c95-3a51-4108-8bea-79260b744ef0', 'a0cedb60-ace2-408f-9845-bf344bf0d13b', 'f0033574-2a53-4cf4-994b-ea94cfff6faf'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:33 devstack sudo[108513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:59:33 devstack sudo[108513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:33 devstack sudo[108513]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.238s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:59:33 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Deleted volume successfully. Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b9e96254-581b-455f-84ff-ee7222c0cee6 tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-6b5fc508-34ac-436d-ab8c-47d9c0993301-delete_volume" released by "delete_volume" :: held 1.065s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "cinder-9de500e8-efe4-43fe-a6d4-ed7500e7040c-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-9de500e8-efe4-43fe-a6d4-ed7500e7040c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "cinder-quobyte-9de500e8-efe4-43fe-a6d4-ed7500e7040c" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-quobyte-9de500e8-efe4-43fe-a6d4-ed7500e7040c" acquired by "delete_volume" :: waited 0.014s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[31dae567-6edb-4be7-b609-8b929519c9b7]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:33 devstack sudo[108516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c Aug 09 12:59:33 devstack sudo[108516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:34 devstack sudo[108516]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c" returned: 0 in 0.348s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:34 devstack sudo[108521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c Aug 09 12:59:34 devstack sudo[108521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:34 devstack sudo[108521]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9de500e8-efe4-43fe-a6d4-ed7500e7040c" returned: 0 in 0.251s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-quobyte-9de500e8-efe4-43fe-a6d4-ed7500e7040c" released by "delete_volume" :: held 0.635s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Created reservations ['ba6ec0e4-e328-4d30-a38a-604782829032', '9265205a-4803-4867-b83f-f27d90c74a1a', 'ebc58037-caa1-4eea-8a76-46eaf2b169b2', '062667f1-4edb-4b75-9fed-70879aea3db6'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:34 devstack sudo[108524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:59:34 devstack sudo[108524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:34 devstack sudo[108524]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.243s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:59:34 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Deleted volume successfully. Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-29a58840-23e4-4214-8e85-c4c782a63abe tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-9de500e8-efe4-43fe-a6d4-ed7500e7040c-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "cinder-de584664-19da-4474-a8f2-0eae67aae7e2-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-de584664-19da-4474-a8f2-0eae67aae7e2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "cinder-quobyte-de584664-19da-4474-a8f2-0eae67aae7e2" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-quobyte-de584664-19da-4474-a8f2-0eae67aae7e2" acquired by "delete_volume" :: waited 0.013s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[77152b70-cccc-4cca-9643-1d9dd32dc56c]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de584664-19da-4474-a8f2-0eae67aae7e2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:34 devstack sudo[108527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de584664-19da-4474-a8f2-0eae67aae7e2 Aug 09 12:59:34 devstack sudo[108527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:35 devstack sudo[108527]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de584664-19da-4474-a8f2-0eae67aae7e2" returned: 0 in 0.346s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de584664-19da-4474-a8f2-0eae67aae7e2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:35 devstack sudo[108532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de584664-19da-4474-a8f2-0eae67aae7e2 Aug 09 12:59:35 devstack sudo[108532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:35 devstack sudo[108532]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de584664-19da-4474-a8f2-0eae67aae7e2" returned: 0 in 0.248s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-quobyte-de584664-19da-4474-a8f2-0eae67aae7e2" released by "delete_volume" :: held 0.632s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Created reservations ['ca760e12-5e32-4ef7-9d81-9a54d14ff866', 'a302d3fe-1c58-47d3-96c9-b8426c76ec30', 'd5e19e13-aeb3-4ff1-b2f5-979516d9e7c2', 'cebc34ab-ebb4-465d-a2ad-e33696561918'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:35 devstack sudo[108535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:59:35 devstack sudo[108535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:35 devstack sudo[108535]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.242s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:59:35 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Deleted volume successfully. Aug 09 12:59:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d1630893-cbab-4a4e-9775-c3ec4b133f9c tempest-CreateVolumesFromImageTest-943004060 None] Lock "cinder-de584664-19da-4474-a8f2-0eae67aae7e2-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Flow 'volume_create_manager' (1c4b77e6-4ab3-43d4-9a18-da76e5520689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5011ff-1e70-4964-a2f6-d291cab491c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd5011ff-1e70-4964-a2f6-d291cab491c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-352379366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=050eaff7-31ac-4539-8442-edecdfa1b8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a90bd36102d4fcb8f4c24669e7296c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:59:39Z,use_quota=True,user_id='8168faffd1784a9c8144dfe4581d4880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8365966-42c5-48c9-8ae2-bdff306982cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8365966-42c5-48c9-8ae2-bdff306982cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b973a71-6909-486d-9d61-8d9ab6bcd58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b973a71-6909-486d-9d61-8d9ab6bcd58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '050eaff7-31ac-4539-8442-edecdfa1b8ba', 'volume_name': 'volume-050eaff7-31ac-4539-8442-edecdfa1b8ba', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e09909-bfc2-4f8a-895d-0b412a7f5994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6e09909-bfc2-4f8a-895d-0b412a7f5994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92921e0-ca75-4c6d-83ed-5bdfab11fbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:38 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Volume 050eaff7-31ac-4539-8442-edecdfa1b8ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-050eaff7-31ac-4539-8442-edecdfa1b8ba', 'volume_size': 1} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-352379366',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=050eaff7-31ac-4539-8442-edecdfa1b8ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a90bd36102d4fcb8f4c24669e7296c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:59:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:59:39Z,use_quota=True,user_id='8168faffd1784a9c8144dfe4581d4880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Creating volume 050eaff7-31ac-4539-8442-edecdfa1b8ba {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:59:38 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 12:59:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:38 devstack sudo[108539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba 1073741824 Aug 09 12:59:38 devstack sudo[108539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:39 devstack sudo[108539]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba 1073741824" returned: 0 in 0.396s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:39 devstack sudo[108545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba Aug 09 12:59:39 devstack sudo[108545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:39 devstack sudo[108545]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba" returned: 0 in 0.236s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] <== create_volume: return (678ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.680s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92921e0-ca75-4c6d-83ed-5bdfab11fbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-050eaff7-31ac-4539-8442-edecdfa1b8ba', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277784e7-e060-4809-92c4-a3b6e8d9fa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:39 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Volume volume-050eaff7-31ac-4539-8442-edecdfa1b8ba (050eaff7-31ac-4539-8442-edecdfa1b8ba): created successfully Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (277784e7-e060-4809-92c4-a3b6e8d9fa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Flow 'volume_create_manager' (1c4b77e6-4ab3-43d4-9a18-da76e5520689) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:39 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-59e41f58-6053-4b96-9e80-96a33ace26a5 tempest-VolumeDependencyTests-603035254 None] Created volume successfully. Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] Creating offline snapshot d17ee1c2-bb4a-40ca-81c5-338386e34894 of volume 050eaff7-31ac-4539-8442-edecdfa1b8ba {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f4a019-43a7-4c52-b3ea-2001d12eff01]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:39 devstack sudo[108549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba Aug 09 12:59:39 devstack sudo[108549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:40 devstack sudo[108549]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba" returned: 0 in 0.357s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:40 devstack sudo[108554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 1G Aug 09 12:59:40 devstack sudo[108554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:40 devstack sudo[108554]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 1G" returned: 0 in 0.397s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050eaff7-31ac-4539-8442-edecdfa1b8ba -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:40 devstack sudo[108560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050eaff7-31ac-4539-8442-edecdfa1b8ba -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 Aug 09 12:59:40 devstack sudo[108560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:40 devstack sudo[108560]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-050eaff7-31ac-4539-8442-edecdfa1b8ba -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894" returned: 0 in 0.279s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:40 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 is being set with open permissions: ugo+rw Aug 09 12:59:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:40 devstack sudo[108565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 Aug 09 12:59:40 devstack sudo[108565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:41 devstack sudo[108565]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894" returned: 0 in 0.242s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:41 devstack sudo[108568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.info Aug 09 12:59:41 devstack sudo[108568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:41 devstack sudo[108568]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.info" returned: 0 in 0.241s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:41 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.info is being set with open permissions: ugo+rw Aug 09 12:59:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:41 devstack sudo[108571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.info Aug 09 12:59:41 devstack sudo[108571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:41 devstack sudo[108571]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.info" returned: 0 in 0.245s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.856s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:41 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c5dfc43e-4fe1-4d38-bcdd-7ed198c3fb3f tempest-VolumeDependencyTests-603035254 None] Create snapshot completed successfully Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Flow 'volume_create_manager' (f3e7f958-7fa2-45ac-8913-50e622884d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce836d90-776a-4b41-910e-4550967a2498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce836d90-776a-4b41-910e-4550967a2498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T10:59:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-614107363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ab027f0-3a7e-4dfe-b72a-44904b02aef0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9a90bd36102d4fcb8f4c24669e7296c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T10:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d17ee1c2-bb4a-40ca-81c5-338386e34894,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T10:59:42Z,use_quota=True,user_id='8168faffd1784a9c8144dfe4581d4880',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4877b3-d5bb-4e1b-bd77-33f997064c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db4877b3-d5bb-4e1b-bd77-33f997064c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a97beb-3758-4c36-bc51-7666350b5bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4a97beb-3758-4c36-bc51-7666350b5bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1ab027f0-3a7e-4dfe-b72a-44904b02aef0', 'volume_name': 'volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0', 'volume_size': 1, 'snapshot_id': 'd17ee1c2-bb4a-40ca-81c5-338386e34894'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a795e7cb-b81a-4e7d-94eb-5ebe10647eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a795e7cb-b81a-4e7d-94eb-5ebe10647eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a413baa7-039b-4a3d-96ad-7f41357336b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:42 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Volume 1ab027f0-3a7e-4dfe-b72a-44904b02aef0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0', 'volume_size': 1, 'snapshot_id': 'd17ee1c2-bb4a-40ca-81c5-338386e34894'} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Acquiring lock "cinder-quobyte-d17ee1c2-bb4a-40ca-81c5-338386e34894-1ab027f0-3a7e-4dfe-b72a-44904b02aef0" by "_create_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-quobyte-d17ee1c2-bb4a-40ca-81c5-338386e34894-1ab027f0-3a7e-4dfe-b72a-44904b02aef0" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Creating volume 1ab027f0-3a7e-4dfe-b72a-44904b02aef0 from snapshot d17ee1c2-bb4a-40ca-81c5-338386e34894 {{(pid=89309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Acquiring lock "cinder-quobyte-1ab027f0-3a7e-4dfe-b72a-44904b02aef0" by "_copy_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-quobyte-1ab027f0-3a7e-4dfe-b72a-44904b02aef0" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] snapshot: d17ee1c2-bb4a-40ca-81c5-338386e34894, volume: 1ab027f0-3a7e-4dfe-b72a-44904b02aef0, {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e835b6-fe9c-4964-9c69-9b0a29277285]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:42 devstack sudo[108574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 Aug 09 12:59:42 devstack sudo[108574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:42 devstack sudo[108574]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894" returned: 0 in 0.359s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050eaff7-31ac-4539-8442-edecdfa1b8ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd09834-21fc-4e83-9143-583bcf8c3d09]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:43 devstack sudo[108579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba Aug 09 12:59:43 devstack sudo[108579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:43 devstack sudo[108579]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba" returned: 0 in 0.354s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 12:59:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Creating direct copy from snapshot {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 12:59:43 devstack cinder-volume[89309]: DEBUG cinder.utils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Path /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0 not found in is_blk_device check {{(pid=89309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 12:59:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:43 devstack sudo[108584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0 Aug 09 12:59:43 devstack sudo[108584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:47 devstack sudo[108584]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0" returned: 0 in 4.231s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:47 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba, size 1024.00 MB, duration 4.23 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 12:59:47 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Converted 1024.00 MB image at 241.94 MB/s Aug 09 12:59:47 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0 is being set with open permissions: ugo+rw Aug 09 12:59:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:47 devstack sudo[108633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0 Aug 09 12:59:47 devstack sudo[108633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:47 devstack sudo[108633]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0" returned: 0 in 0.251s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-quobyte-1ab027f0-3a7e-4dfe-b72a-44904b02aef0" released by "_copy_volume_from_snapshot" :: held 5.269s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-quobyte-d17ee1c2-bb4a-40ca-81c5-338386e34894-1ab027f0-3a7e-4dfe-b72a-44904b02aef0" released by "_create_volume_from_snapshot" :: held 5.343s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.357s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a413baa7-039b-4a3d-96ad-7f41357336b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0', 'volume_size': 1, 'snapshot_id': 'd17ee1c2-bb4a-40ca-81c5-338386e34894'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0050cdb-f19a-4e4e-a59f-39bee16b78bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 12:59:47 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Volume volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0 (1ab027f0-3a7e-4dfe-b72a-44904b02aef0): created successfully Aug 09 12:59:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0050cdb-f19a-4e4e-a59f-39bee16b78bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 12:59:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Flow 'volume_create_manager' (f3e7f958-7fa2-45ac-8913-50e622884d22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 12:59:47 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-10f050ef-d586-41aa-b8de-b2a8ed6a51a3 tempest-VolumeDependencyTests-603035254 None] Created volume successfully. Aug 09 12:59:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Acquiring lock "cinder-d17ee1c2-bb4a-40ca-81c5-338386e34894-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-d17ee1c2-bb4a-40ca-81c5-338386e34894-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Acquiring lock "cinder-quobyte-050eaff7-31ac-4539-8442-edecdfa1b8ba" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-quobyte-050eaff7-31ac-4539-8442-edecdfa1b8ba" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Acquiring lock "cinder-quobyte-d17ee1c2-bb4a-40ca-81c5-338386e34894" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-quobyte-d17ee1c2-bb4a-40ca-81c5-338386e34894" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Deleting offline snapshot d17ee1c2-bb4a-40ca-81c5-338386e34894 of volume 050eaff7-31ac-4539-8442-edecdfa1b8ba {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 12:59:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] snapshot_file for this snap is: volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 12:59:48 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9892656-7d02-4d86-9f59-5631d4925236]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:49 devstack sudo[108638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 Aug 09 12:59:49 devstack sudo[108638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:49 devstack sudo[108638]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894" returned: 0 in 0.346s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-050eaff7-31ac-4539-8442-edecdfa1b8ba(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 12:59:49 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d14dda2-a3bf-4cc4-9bb0-6d4916a5a30d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:49 devstack sudo[108643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba Aug 09 12:59:49 devstack sudo[108643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:49 devstack sudo[108643]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba" returned: 0 in 0.552s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:49 devstack sudo[108648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 Aug 09 12:59:49 devstack sudo[108648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:50 devstack sudo[108648]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894" returned: 0 in 0.340s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:50 devstack sudo[108653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894 Aug 09 12:59:50 devstack sudo[108653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:50 devstack sudo[108653]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba.d17ee1c2-bb4a-40ca-81c5-338386e34894" returned: 0 in 0.241s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:50 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-quobyte-d17ee1c2-bb4a-40ca-81c5-338386e34894" released by "_delete_snapshot" :: held 1.571s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:50 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-quobyte-050eaff7-31ac-4539-8442-edecdfa1b8ba" released by "delete_snapshot" :: held 1.593s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:50 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Created reservations ['d5b43c04-d175-400e-941d-11483c92d259', '4331c9bf-0b6c-4d81-b7a0-e2b7f1da9e9a', '3f6ecfd2-0d3d-4a9a-acf2-04eb92417862', 'ef51bcd8-0d99-41cd-a437-5e3c43aef4bd'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:59:50 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Delete snapshot completed successfully. Aug 09 12:59:50 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-61007b46-ae6b-406b-b843-f3d37f8d1fd9 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-d17ee1c2-bb4a-40ca-81c5-338386e34894-delete_snapshot" released by "delete_snapshot" :: held 1.744s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Acquiring lock "cinder-050eaff7-31ac-4539-8442-edecdfa1b8ba-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Lock "cinder-050eaff7-31ac-4539-8442-edecdfa1b8ba-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Acquiring lock "cinder-quobyte-050eaff7-31ac-4539-8442-edecdfa1b8ba" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Lock "cinder-quobyte-050eaff7-31ac-4539-8442-edecdfa1b8ba" acquired by "delete_volume" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4129de6f-415f-4c30-9474-23dca228d9ef]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:51 devstack sudo[108657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba Aug 09 12:59:51 devstack sudo[108657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:51 devstack sudo[108657]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba" returned: 0 in 0.345s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:51 devstack sudo[108662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba Aug 09 12:59:51 devstack sudo[108662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:51 devstack sudo[108662]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-050eaff7-31ac-4539-8442-edecdfa1b8ba" returned: 0 in 0.234s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Lock "cinder-quobyte-050eaff7-31ac-4539-8442-edecdfa1b8ba" released by "delete_volume" :: held 0.632s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Created reservations ['a67c0d51-1e5e-45a2-99b9-f9f59c70e875', '3d19cabb-9819-4751-8fa6-a5b8375864bc', 'ee817bb4-ed94-4fc9-bb44-41425886421d', 'b70fc45f-e7a9-4a89-af9f-753eaa1ff5bc'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:51 devstack sudo[108665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:59:51 devstack sudo[108665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:52 devstack sudo[108665]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.237s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:59:52 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Deleted volume successfully. Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0428d55f-33a6-47ef-baab-e4b7f87ec3fd tempest-VolumeDependencyTests-603035254 None] Lock "cinder-050eaff7-31ac-4539-8442-edecdfa1b8ba-delete_volume" released by "delete_volume" :: held 1.057s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Acquiring lock "cinder-1ab027f0-3a7e-4dfe-b72a-44904b02aef0-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-1ab027f0-3a7e-4dfe-b72a-44904b02aef0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Acquiring lock "cinder-quobyte-1ab027f0-3a7e-4dfe-b72a-44904b02aef0" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-quobyte-1ab027f0-3a7e-4dfe-b72a-44904b02aef0" acquired by "delete_volume" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3b9ad5b-0028-45c1-853d-7df28ef8fab5]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:52 devstack sudo[108668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0 Aug 09 12:59:52 devstack sudo[108668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:52 devstack sudo[108668]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0" returned: 0 in 0.358s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:52 devstack sudo[108673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0 Aug 09 12:59:52 devstack sudo[108673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:52 devstack sudo[108673]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1ab027f0-3a7e-4dfe-b72a-44904b02aef0" returned: 0 in 0.240s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-quobyte-1ab027f0-3a7e-4dfe-b72a-44904b02aef0" released by "delete_volume" :: held 0.636s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:52 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Created reservations ['5ca90265-5425-4f90-a440-ba031d732536', '54d7394c-e3c6-4795-b4fb-dcf6e62ffa7d', '5feeaa66-0c47-447d-b489-1111dd8e6586', 'bab1890a-28f6-41b1-9f69-f453af222eee'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 12:59:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:53 devstack sudo[108676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:59:53 devstack sudo[108676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:53 devstack sudo[108676]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.233s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:53 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:59:53 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Deleted volume successfully. Aug 09 12:59:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-dc29e64f-136d-4ca8-a209-2b5865e61fa7 tempest-VolumeDependencyTests-603035254 None] Lock "cinder-1ab027f0-3a7e-4dfe-b72a-44904b02aef0-delete_volume" released by "delete_volume" :: held 1.064s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 12:59:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:59:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 12:59:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 12:59:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 12:59:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 12:59:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 12:59:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 12:59:57 devstack sudo[108687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 12:59:57 devstack sudo[108687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 12:59:58 devstack sudo[108687]: pam_unix(sudo:session): session closed for user root Aug 09 12:59:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.245s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 12:59:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 12:59:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 12:59:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 12:59:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 13:00:03 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=61,cinder:UPDATE=82,cinder:INSERT=20,cinder:DELETE=7 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 13:00:03 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=87,cinder:SELECT=59,cinder:INSERT=20,cinder:DELETE=8 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Flow 'volume_create_manager' (7e5a4600-36d3-4d2b-9b55-936a8fff20f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1dec01-e679-4898-8300-133e7781bf50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee1dec01-e679-4898-8300-133e7781bf50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1816007814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1976ad-e785-49b2-8a95-5807b2f7e050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7906595c66f45ae89d7c5c08a7326f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:09Z,use_quota=True,user_id='edbdab5b87334803a5815161a6ec391b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177925b3-daeb-4976-b349-1c1d32736c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (177925b3-daeb-4976-b349-1c1d32736c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52fbfaa-cf45-4050-bce7-9beea3ac0c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c52fbfaa-cf45-4050-bce7-9beea3ac0c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b1976ad-e785-49b2-8a95-5807b2f7e050', 'volume_name': 'volume-7b1976ad-e785-49b2-8a95-5807b2f7e050', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f6f5ae-5ba9-45f6-966b-b3189e961e72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32f6f5ae-5ba9-45f6-966b-b3189e961e72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2c0384-39c5-449d-b85c-21639df037ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:09 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Volume 7b1976ad-e785-49b2-8a95-5807b2f7e050: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b1976ad-e785-49b2-8a95-5807b2f7e050', 'volume_size': 1} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1816007814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b1976ad-e785-49b2-8a95-5807b2f7e050,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7906595c66f45ae89d7c5c08a7326f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:09Z,use_quota=True,user_id='edbdab5b87334803a5815161a6ec391b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Creating volume 7b1976ad-e785-49b2-8a95-5807b2f7e050 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:09 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7b1976ad-e785-49b2-8a95-5807b2f7e050 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:09 devstack sudo[108731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7b1976ad-e785-49b2-8a95-5807b2f7e050 1073741824 Aug 09 13:00:09 devstack sudo[108731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Flow 'volume_create_manager' (4768718f-b52c-4f3d-b07b-49597ab40ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6032e4f3-528f-47e9-80a5-4c6d45eddea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6032e4f3-528f-47e9-80a5-4c6d45eddea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1348162949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bd1206-1894-4e83-b7e0-5c06f12bb6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7906595c66f45ae89d7c5c08a7326f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:09Z,use_quota=True,user_id='edbdab5b87334803a5815161a6ec391b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3814f6-7fbc-4c5c-aa9f-cd45c1a4f0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3814f6-7fbc-4c5c-aa9f-cd45c1a4f0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a407099-bab6-45e7-a158-38b7eda24b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a407099-bab6-45e7-a158-38b7eda24b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2bd1206-1894-4e83-b7e0-5c06f12bb6dd', 'volume_name': 'volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6594860-33b7-49f5-a56f-230bd2facf91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6594860-33b7-49f5-a56f-230bd2facf91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0abf9c-0802-44fd-81c6-84b75bedf19f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:09 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Volume d2bd1206-1894-4e83-b7e0-5c06f12bb6dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd', 'volume_size': 1} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:09 devstack sudo[108731]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7b1976ad-e785-49b2-8a95-5807b2f7e050 1073741824" returned: 0 in 0.604s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7b1976ad-e785-49b2-8a95-5807b2f7e050 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:09 devstack sudo[108737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7b1976ad-e785-49b2-8a95-5807b2f7e050 Aug 09 13:00:09 devstack sudo[108737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Flow 'volume_create_manager' (e06d134b-41e7-41b9-9680-bf94c81336d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b633ad-d1b8-411e-9d16-3cc8acf567fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b633ad-d1b8-411e-9d16-3cc8acf567fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1561697117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31954253-c319-44f9-bbb5-e685869e3ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7906595c66f45ae89d7c5c08a7326f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:10Z,use_quota=True,user_id='edbdab5b87334803a5815161a6ec391b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5ff2e0-c852-46f1-b7e3-a9cdbf7a3d30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec5ff2e0-c852-46f1-b7e3-a9cdbf7a3d30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3e70d3-1599-4f85-b7aa-559d6eb0d5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c3e70d3-1599-4f85-b7aa-559d6eb0d5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31954253-c319-44f9-bbb5-e685869e3ca3', 'volume_name': 'volume-31954253-c319-44f9-bbb5-e685869e3ca3', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8d5fa6-a638-489a-96a8-a7f47d2bd7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d8d5fa6-a638-489a-96a8-a7f47d2bd7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6c8729-467e-4f69-8a8a-bf469a6b044c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:10 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Volume 31954253-c319-44f9-bbb5-e685869e3ca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31954253-c319-44f9-bbb5-e685869e3ca3', 'volume_size': 1} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:10 devstack sudo[108737]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7b1976ad-e785-49b2-8a95-5807b2f7e050" returned: 0 in 0.411s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.091s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1348162949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2bd1206-1894-4e83-b7e0-5c06f12bb6dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7906595c66f45ae89d7c5c08a7326f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:09Z,use_quota=True,user_id='edbdab5b87334803a5815161a6ec391b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Creating volume d2bd1206-1894-4e83-b7e0-5c06f12bb6dd {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:10 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a2c0384-39c5-449d-b85c-21639df037ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b1976ad-e785-49b2-8a95-5807b2f7e050', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b9813a-20ca-4386-95cb-26e3f9a142b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:10 devstack sudo[108740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd 1073741824 Aug 09 13:00:10 devstack sudo[108740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:10 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Volume volume-7b1976ad-e785-49b2-8a95-5807b2f7e050 (7b1976ad-e785-49b2-8a95-5807b2f7e050): created successfully Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29b9813a-20ca-4386-95cb-26e3f9a142b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Flow 'volume_create_manager' (7e5a4600-36d3-4d2b-9b55-936a8fff20f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:10 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-dde8d5d2-bc8c-4aa9-b32d-f10d311a9af3 tempest-CreateVolumesFromImageTest-966870949 None] Created volume successfully. Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Flow 'volume_create_manager' (24a1e1ab-bff2-4e75-a1c3-57fea838e52a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d060fe71-bcb9-499d-af54-7d1cc059089f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d060fe71-bcb9-499d-af54-7d1cc059089f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-901520918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cdb650-8f23-4699-948e-9a90efa2c6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7906595c66f45ae89d7c5c08a7326f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:11Z,use_quota=True,user_id='edbdab5b87334803a5815161a6ec391b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f013ce-2a7c-41ea-b066-842bb1eb2404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16f013ce-2a7c-41ea-b066-842bb1eb2404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865c2fe0-95de-4b9e-81ab-c6e9336d6631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (865c2fe0-95de-4b9e-81ab-c6e9336d6631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33cdb650-8f23-4699-948e-9a90efa2c6ce', 'volume_name': 'volume-33cdb650-8f23-4699-948e-9a90efa2c6ce', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb04af50-fe8a-4089-b1ba-72793b2cfbf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb04af50-fe8a-4089-b1ba-72793b2cfbf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:11 devstack sudo[108740]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89bff53-5a2e-4da7-ac58-ca5d8c5a3164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:11 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Volume 33cdb650-8f23-4699-948e-9a90efa2c6ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33cdb650-8f23-4699-948e-9a90efa2c6ce', 'volume_size': 1} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd 1073741824" returned: 0 in 0.718s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Flow 'volume_create_manager' (6048203f-1d45-4dec-806b-95c385e49518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49251aaf-e811-4195-abb0-6b43694a4ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49251aaf-e811-4195-abb0-6b43694a4ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-706225608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1024b8-a7fc-4426-9bc5-258aaef0cfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7906595c66f45ae89d7c5c08a7326f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:11Z,use_quota=True,user_id='edbdab5b87334803a5815161a6ec391b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145dc7e4-eeb2-4d82-ae9a-fe1563f4c5cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (145dc7e4-eeb2-4d82-ae9a-fe1563f4c5cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:11 devstack sudo[108747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd Aug 09 13:00:11 devstack sudo[108747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b535533f-b589-42ce-966e-6757b4515397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b535533f-b589-42ce-966e-6757b4515397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d1024b8-a7fc-4426-9bc5-258aaef0cfee', 'volume_name': 'volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bb4509-c42c-44cf-b2f0-021c9e6aadf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (54bb4509-c42c-44cf-b2f0-021c9e6aadf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cabbf5-fa02-4a02-ba10-18eee02b7df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:11 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Volume 3d1024b8-a7fc-4426-9bc5-258aaef0cfee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee', 'volume_size': 1} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:11 devstack sudo[108747]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd" returned: 0 in 0.302s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.207s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1561697117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31954253-c319-44f9-bbb5-e685869e3ca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7906595c66f45ae89d7c5c08a7326f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:10Z,use_quota=True,user_id='edbdab5b87334803a5815161a6ec391b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Creating volume 31954253-c319-44f9-bbb5-e685869e3ca3 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:11 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-31954253-c319-44f9-bbb5-e685869e3ca3 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0abf9c-0802-44fd-81c6-84b75bedf19f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af100089-d8ff-470a-9aff-5a275a34dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:11 devstack sudo[108750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-31954253-c319-44f9-bbb5-e685869e3ca3 1073741824 Aug 09 13:00:11 devstack sudo[108750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:11 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Volume volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd (d2bd1206-1894-4e83-b7e0-5c06f12bb6dd): created successfully Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af100089-d8ff-470a-9aff-5a275a34dad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Flow 'volume_create_manager' (4768718f-b52c-4f3d-b07b-49597ab40ae1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:11 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2a4a5f0f-24c3-4ff8-9077-bee0501ad9b6 tempest-CreateVolumesFromImageTest-966870949 None] Created volume successfully. Aug 09 13:00:11 devstack sudo[108750]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-31954253-c319-44f9-bbb5-e685869e3ca3 1073741824" returned: 0 in 0.493s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-31954253-c319-44f9-bbb5-e685869e3ca3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:11 devstack sudo[108757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-31954253-c319-44f9-bbb5-e685869e3ca3 Aug 09 13:00:11 devstack sudo[108757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:12 devstack sudo[108757]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-31954253-c319-44f9-bbb5-e685869e3ca3" returned: 0 in 0.318s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-901520918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33cdb650-8f23-4699-948e-9a90efa2c6ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7906595c66f45ae89d7c5c08a7326f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:11Z,use_quota=True,user_id='edbdab5b87334803a5815161a6ec391b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Creating volume 33cdb650-8f23-4699-948e-9a90efa2c6ce {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:12 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-33cdb650-8f23-4699-948e-9a90efa2c6ce 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc6c8729-467e-4f69-8a8a-bf469a6b044c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31954253-c319-44f9-bbb5-e685869e3ca3', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572c34a6-0ce9-4bf1-8bd2-9e91fc150ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:12 devstack sudo[108761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-33cdb650-8f23-4699-948e-9a90efa2c6ce 1073741824 Aug 09 13:00:12 devstack sudo[108761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:12 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Volume volume-31954253-c319-44f9-bbb5-e685869e3ca3 (31954253-c319-44f9-bbb5-e685869e3ca3): created successfully Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572c34a6-0ce9-4bf1-8bd2-9e91fc150ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:12 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Flow 'volume_create_manager' (e06d134b-41e7-41b9-9680-bf94c81336d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:12 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-aa7a10c3-943d-4d38-8949-c28cbe24c3b5 tempest-CreateVolumesFromImageTest-966870949 None] Created volume successfully. Aug 09 13:00:13 devstack sudo[108761]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-33cdb650-8f23-4699-948e-9a90efa2c6ce 1073741824" returned: 0 in 0.703s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-33cdb650-8f23-4699-948e-9a90efa2c6ce {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:13 devstack sudo[108768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-33cdb650-8f23-4699-948e-9a90efa2c6ce Aug 09 13:00:13 devstack sudo[108768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Flow 'volume_create_manager' (f8c8ad17-90c8-4f5f-bedf-312330e0ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3048dcd5-5cbb-42b3-a8f8-4d46e08285b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3048dcd5-5cbb-42b3-a8f8-4d46e08285b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d48c72-58fb-4150-bdaa-5f052d351712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c056551e336c4060b55adff40d236089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:13Z,use_quota=True,user_id='342047c0c8514ff388dcd350bb622bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9d425c-4243-4145-85a5-4a4658a9c426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc9d425c-4243-4145-85a5-4a4658a9c426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4531e1b9-532d-48cf-a40a-dad8e6868a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.image.glance [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Creating Keystone auth plugin from conf {{(pid=89309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 13:00:13 devstack sudo[108768]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-33cdb650-8f23-4699-948e-9a90efa2c6ce" returned: 0 in 0.318s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] <== create_volume: return (1096ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.215s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-706225608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d1024b8-a7fc-4426-9bc5-258aaef0cfee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7906595c66f45ae89d7c5c08a7326f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:11Z,use_quota=True,user_id='edbdab5b87334803a5815161a6ec391b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Creating volume 3d1024b8-a7fc-4426-9bc5-258aaef0cfee {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:13 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b89bff53-5a2e-4da7-ac58-ca5d8c5a3164) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33cdb650-8f23-4699-948e-9a90efa2c6ce', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe6febb-a496-43c4-976d-148bf5fa71e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:13 devstack sudo[108771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee 1073741824 Aug 09 13:00:13 devstack sudo[108771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:13 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Volume volume-33cdb650-8f23-4699-948e-9a90efa2c6ce (33cdb650-8f23-4699-948e-9a90efa2c6ce): created successfully Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbe6febb-a496-43c4-976d-148bf5fa71e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Flow 'volume_create_manager' (24a1e1ab-bff2-4e75-a1c3-57fea838e52a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:13 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-53594c9c-1345-4be5-965e-02216170ab9f tempest-CreateVolumesFromImageTest-966870949 None] Created volume successfully. Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4531e1b9-532d-48cf-a40a-dad8e6868a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '96d48c72-58fb-4150-bdaa-5f052d351712', 'volume_name': 'volume-96d48c72-58fb-4150-bdaa-5f052d351712', 'volume_size': 1, 'image_id': '60aabf87-5d34-45d9-8120-129940aaf5f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60aabf87-5d34-45d9-8120-129940aaf5f1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7535cd5aac76da3b3c7583d06dd26e37', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c056551e336c4060b55adff40d236089', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cca1bd4f67fa0051f1e2427d7619cf4720fcfe13c0c9f59d2074bd419b09cbb7840df65706696e3f32f8a9786a931750c3399bd19d311b5430969f231aeb54ed', 'id': '60aabf87-5d34-45d9-8120-129940aaf5f1', 'created_at': datetime.datetime(2026, 8, 9, 11, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 11, 0, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60aabf87-5d34-45d9-8120-129940aaf5f1/file', 'properties': {}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24564208-64c6-4123-86ec-d526358d84d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24564208-64c6-4123-86ec-d526358d84d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c48a44-95f1-4fdd-808c-7d7a0304cb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:14 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Volume 96d48c72-58fb-4150-bdaa-5f052d351712: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-96d48c72-58fb-4150-bdaa-5f052d351712', 'volume_size': 1, 'image_id': '60aabf87-5d34-45d9-8120-129940aaf5f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60aabf87-5d34-45d9-8120-129940aaf5f1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7535cd5aac76da3b3c7583d06dd26e37', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c056551e336c4060b55adff40d236089', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cca1bd4f67fa0051f1e2427d7619cf4720fcfe13c0c9f59d2074bd419b09cbb7840df65706696e3f32f8a9786a931750c3399bd19d311b5430969f231aeb54ed', 'id': '60aabf87-5d34-45d9-8120-129940aaf5f1', 'created_at': datetime.datetime(2026, 8, 9, 11, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 11, 0, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60aabf87-5d34-45d9-8120-129940aaf5f1/file', 'properties': {}}, 'image_service': } Aug 09 13:00:14 devstack sudo[108771]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Trying to clone 96d48c72-58fb-4150-bdaa-5f052d351712 from image 60aabf87-5d34-45d9-8120-129940aaf5f1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/60aabf87-5d34-45d9-8120-129940aaf5f1', 'metadata': {}}]). {{(pid=89309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee 1073741824" returned: 0 in 0.658s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:14 devstack sudo[108777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee Aug 09 13:00:14 devstack sudo[108777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 13:00:14 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Image download 0.00 MB at 0.00 MB/s Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bde8bd-309b-4c0a-b45c-7b2483b4b9ad]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:14 devstack sudo[108779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD Aug 09 13:00:14 devstack sudo[108779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:14 devstack sudo[108777]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee" returned: 0 in 0.287s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49cabbf5-fa02-4a02-ba10-18eee02b7df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e230014-4b90-49f4-a4fa-544c0a907d0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:14 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Volume volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee (3d1024b8-a7fc-4426-9bc5-258aaef0cfee): created successfully Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e230014-4b90-49f4-a4fa-544c0a907d0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Flow 'volume_create_manager' (6048203f-1d45-4dec-806b-95c385e49518) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:14 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e5774f9f-0eef-4a4b-aa80-749a1f3249e8 tempest-CreateVolumesFromImageTest-966870949 None] Created volume successfully. Aug 09 13:00:14 devstack sudo[108779]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD" returned: 0 in 0.405s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "cinder-3d1024b8-a7fc-4426-9bc5-258aaef0cfee-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-3d1024b8-a7fc-4426-9bc5-258aaef0cfee-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "cinder-quobyte-3d1024b8-a7fc-4426-9bc5-258aaef0cfee" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-quobyte-3d1024b8-a7fc-4426-9bc5-258aaef0cfee" acquired by "delete_volume" :: waited 0.032s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:14 devstack sudo[108784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD Aug 09 13:00:14 devstack sudo[108784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3061053-1fce-4d6c-a415-7b1d979a81b6]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Flow 'volume_create_manager' (9f96284f-7958-4fd2-8b0a-9523a2795ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd58fbf-482a-4599-b54c-a7972aa4ec53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:15 devstack sudo[108788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee Aug 09 13:00:15 devstack sudo[108788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cfd58fbf-482a-4599-b54c-a7972aa4ec53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f35485-7442-48b2-953d-ded58c33878d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de8eaa098dc4b838026c5360c6aa229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:15Z,use_quota=True,user_id='08cd067098774fb8a2bba780812374ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71918921-44ee-4fc7-8f5d-c99a42e09870),volume_type_id=71918921-44ee-4fc7-8f5d-c99a42e09870)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645cf55d-9915-444b-ba3e-489bd1850a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (645cf55d-9915-444b-ba3e-489bd1850a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de082a6d-d369-4b09-b73b-fee3f88d3757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.image.glance [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Creating Keystone auth plugin from conf {{(pid=89309) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Aug 09 13:00:15 devstack sudo[108784]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD" returned: 1 in 0.491s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Temporary image 60aabf87-5d34-45d9-8120-129940aaf5f1 is fetched for user 342047c0c8514ff388dcd350bb622bff. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[839e6999-3577-49a7-964b-e71aa9139397]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:15 devstack sudo[108788]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee" returned: 0 in 0.456s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:15 devstack sudo[108797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee Aug 09 13:00:15 devstack sudo[108797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:15 devstack sudo[108795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD Aug 09 13:00:15 devstack sudo[108795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de082a6d-d369-4b09-b73b-fee3f88d3757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '24f35485-7442-48b2-953d-ded58c33878d', 'volume_name': 'volume-24f35485-7442-48b2-953d-ded58c33878d', 'volume_size': 1, 'image_id': '6ff78725-4cb9-4565-941c-f652007bf0ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ff78725-4cb9-4565-941c-f652007bf0ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '357d714cb4e1323d79c7575b0b7d166e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3de8eaa098dc4b838026c5360c6aa229', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1201e87728e72f95e536e3187ebb16fdbcbb90934aeb5dda842aef9e7089cef4c654c2ccebb0b7c6d65bd04ae79ee47567f552b692b9923ce9cebc450559df35', 'id': '6ff78725-4cb9-4565-941c-f652007bf0ad', 'created_at': datetime.datetime(2026, 8, 9, 11, 0, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 11, 0, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ff78725-4cb9-4565-941c-f652007bf0ad/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3468719c-d914-4512-a4d3-4fd0b0cc4fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3468719c-d914-4512-a4d3-4fd0b0cc4fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ca0ed5-52ec-47ba-9335-11df1896d00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:15 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Volume 24f35485-7442-48b2-953d-ded58c33878d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-24f35485-7442-48b2-953d-ded58c33878d', 'volume_size': 1, 'image_id': '6ff78725-4cb9-4565-941c-f652007bf0ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ff78725-4cb9-4565-941c-f652007bf0ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '357d714cb4e1323d79c7575b0b7d166e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3de8eaa098dc4b838026c5360c6aa229', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1201e87728e72f95e536e3187ebb16fdbcbb90934aeb5dda842aef9e7089cef4c654c2ccebb0b7c6d65bd04ae79ee47567f552b692b9923ce9cebc450559df35', 'id': '6ff78725-4cb9-4565-941c-f652007bf0ad', 'created_at': datetime.datetime(2026, 8, 9, 11, 0, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 11, 0, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ff78725-4cb9-4565-941c-f652007bf0ad/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Trying to clone 24f35485-7442-48b2-953d-ded58c33878d from image 6ff78725-4cb9-4565-941c-f652007bf0ad at location (None, [{'url': 'file:///opt/stack/data/glance/images/6ff78725-4cb9-4565-941c-f652007bf0ad', 'metadata': {}}]). {{(pid=89309) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Aug 09 13:00:15 devstack sudo[108795]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD" returned: 0 in 0.394s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:15 devstack sudo[108797]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3d1024b8-a7fc-4426-9bc5-258aaef0cfee" returned: 0 in 0.326s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-quobyte-3d1024b8-a7fc-4426-9bc5-258aaef0cfee" released by "delete_volume" :: held 0.854s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Aug 09 13:00:15 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Image download 0.00 MB at 0.00 MB/s Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[13fe5a7c-83f5-40f1-ba1a-4d77b64e26fb]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:15 devstack sudo[108803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Created reservations ['9c2ec62b-edbe-4e7e-84f0-a93b417c8a28', '80cafe89-e25b-46e1-893b-8a967756b924', 'e96ea7e9-5cb7-462c-94c5-56e5ffb2a966', 'a58872b4-b309-4ac1-990c-d88c8b83bea4'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:15 devstack sudo[108803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:15 devstack sudo[108806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:15 devstack sudo[108806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:15 devstack sudo[108804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD Aug 09 13:00:15 devstack sudo[108804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "cinder-33cdb650-8f23-4699-948e-9a90efa2c6ce-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-33cdb650-8f23-4699-948e-9a90efa2c6ce-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "cinder-quobyte-33cdb650-8f23-4699-948e-9a90efa2c6ce" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-quobyte-33cdb650-8f23-4699-948e-9a90efa2c6ce" acquired by "delete_volume" :: waited 0.043s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:16 devstack sudo[108803]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2b6c0af-614c-46d7-a12a-693a6ab6e962]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-33cdb650-8f23-4699-948e-9a90efa2c6ce {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD" returned: 1 in 0.543s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96d48c72-58fb-4150-bdaa-5f052d351712,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c056551e336c4060b55adff40d236089',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:13Z,use_quota=True,user_id='342047c0c8514ff388dcd350bb622bff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Creating volume 96d48c72-58fb-4150-bdaa-5f052d351712 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:16 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:16 devstack sudo[108813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 1073741824 Aug 09 13:00:16 devstack sudo[108813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:16 devstack sudo[108806]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.403s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:16 devstack sudo[108812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-33cdb650-8f23-4699-948e-9a90efa2c6ce Aug 09 13:00:16 devstack sudo[108812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Deleted volume successfully. Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7d3d05cb-8539-41b5-9913-43486ad841e0 tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-3d1024b8-a7fc-4426-9bc5-258aaef0cfee-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:16 devstack sudo[108804]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD" returned: 0 in 0.620s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:16 devstack sudo[108819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD Aug 09 13:00:16 devstack sudo[108819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:16 devstack sudo[108812]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-33cdb650-8f23-4699-948e-9a90efa2c6ce" returned: 0 in 0.473s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-33cdb650-8f23-4699-948e-9a90efa2c6ce {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:16 devstack sudo[108827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-33cdb650-8f23-4699-948e-9a90efa2c6ce Aug 09 13:00:16 devstack sudo[108827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:16 devstack sudo[108819]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD" returned: 1 in 0.395s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Temporary image 6ff78725-4cb9-4565-941c-f652007bf0ad is fetched for user 08cd067098774fb8a2bba780812374ea. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Aug 09 13:00:16 devstack sudo[108813]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 1073741824" returned: 0 in 0.587s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:16 devstack sudo[108833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 Aug 09 13:00:16 devstack sudo[108833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a031def5-1742-4da8-81b1-69e7459011f1]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:16 devstack sudo[108827]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-33cdb650-8f23-4699-948e-9a90efa2c6ce" returned: 0 in 0.302s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-quobyte-33cdb650-8f23-4699-948e-9a90efa2c6ce" released by "delete_volume" :: held 0.875s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:17 devstack sudo[108836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD Aug 09 13:00:17 devstack sudo[108836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Created reservations ['984024a5-5aef-4a5b-a651-7de204a03576', '54c61ce8-9089-4f8f-973f-3a4ec576efa9', 'e13202d5-e600-436d-8650-bcab89de8184', 'de46a2e3-4ad6-4aca-a842-06829ed40c84'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:17 devstack sudo[108833]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:17 devstack sudo[108839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Flow 'volume_create_manager' (1aeff87c-01a1-4a6d-88da-555cab84fc0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:17 devstack sudo[108839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913dc5c5-739f-4005-82d4-ff624370e778) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712" returned: 0 in 0.396s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.061s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "cinder-31954253-c319-44f9-bbb5-e685869e3ca3-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (913dc5c5-739f-4005-82d4-ff624370e778) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875004657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3f55c9-6b49-4c3c-9307-323c41e54164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f33e25b5e8a490fb86c172de4f7657b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:17Z,use_quota=True,user_id='dedbff7bb09a47de8ad4758bdcc8e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98234d7-6979-421c-bfc3-e642d938de73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98234d7-6979-421c-bfc3-e642d938de73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb788b1-27f8-4763-a130-585cb3ab524d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfb788b1-27f8-4763-a130-585cb3ab524d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a3f55c9-6b49-4c3c-9307-323c41e54164', 'volume_name': 'volume-6a3f55c9-6b49-4c3c-9307-323c41e54164', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:17 devstack sudo[108836]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bea55b-7f35-4652-abf2-ca5a7b4714ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12bea55b-7f35-4652-abf2-ca5a7b4714ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e417edf9-d5b4-4d95-a7db-4e40aa0d8c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:17 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Volume 6a3f55c9-6b49-4c3c-9307-323c41e54164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a3f55c9-6b49-4c3c-9307-323c41e54164', 'volume_size': 1} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1875004657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a3f55c9-6b49-4c3c-9307-323c41e54164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f33e25b5e8a490fb86c172de4f7657b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:17Z,use_quota=True,user_id='dedbff7bb09a47de8ad4758bdcc8e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Creating volume 6a3f55c9-6b49-4c3c-9307-323c41e54164 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:17 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD" returned: 0 in 0.477s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:17 devstack sudo[108843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 1073741824 Aug 09 13:00:17 devstack sudo[108843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-31954253-c319-44f9-bbb5-e685869e3ca3-delete_volume" acquired by "delete_volume" :: waited 0.140s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Attempting download of 60aabf87-5d34-45d9-8120-129940aaf5f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/60aabf87-5d34-45d9-8120-129940aaf5f1', 'metadata': {}}])) to volume 96d48c72-58fb-4150-bdaa-5f052d351712. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "cinder-quobyte-31954253-c319-44f9-bbb5-e685869e3ca3" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:17 devstack sudo[108839]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.321s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[923bdb0e-6c2d-43bd-bfb7-0036613f4a80]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60aabf87-5d34-45d9-8120-129940aaf5f1_isnzkkky {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:17 devstack sudo[108845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD Aug 09 13:00:17 devstack sudo[108845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-quobyte-31954253-c319-44f9-bbb5-e685869e3ca3" acquired by "delete_volume" :: waited 0.034s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:17 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Deleted volume successfully. Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b784aa7f-48da-46bc-ba21-03627d44147b]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-31954253-c319-44f9-bbb5-e685869e3ca3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d79d6482-280c-4e85-9134-15ebc7f94624 tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-33cdb650-8f23-4699-948e-9a90efa2c6ce-delete_volume" released by "delete_volume" :: held 1.609s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:17 devstack sudo[108847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60aabf87-5d34-45d9-8120-129940aaf5f1_isnzkkky Aug 09 13:00:17 devstack sudo[108847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:17 devstack sudo[108849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-31954253-c319-44f9-bbb5-e685869e3ca3 Aug 09 13:00:17 devstack sudo[108849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:17 devstack sudo[108845]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD" returned: 1 in 0.421s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:17 devstack sudo[108843]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 1073741824" returned: 0 in 0.518s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:17 devstack sudo[108861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 Aug 09 13:00:17 devstack sudo[108861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:17 devstack sudo[108847]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_60aabf87-5d34-45d9-8120-129940aaf5f1_isnzkkky" returned: 0 in 0.411s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60aabf87-5d34-45d9-8120-129940aaf5f1_isnzkkky {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:18 devstack sudo[108849]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-31954253-c319-44f9-bbb5-e685869e3ca3" returned: 0 in 0.416s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-31954253-c319-44f9-bbb5-e685869e3ca3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:18 devstack sudo[108868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-31954253-c319-44f9-bbb5-e685869e3ca3 Aug 09 13:00:18 devstack sudo[108868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:18 devstack sudo[108865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60aabf87-5d34-45d9-8120-129940aaf5f1_isnzkkky Aug 09 13:00:18 devstack sudo[108865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:18 devstack sudo[108861]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164" returned: 0 in 0.275s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.387s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f35485-7442-48b2-953d-ded58c33878d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3de8eaa098dc4b838026c5360c6aa229',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:15Z,use_quota=True,user_id='08cd067098774fb8a2bba780812374ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71918921-44ee-4fc7-8f5d-c99a42e09870),volume_type_id=71918921-44ee-4fc7-8f5d-c99a42e09870)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Creating volume 24f35485-7442-48b2-953d-ded58c33878d {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:18 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e417edf9-d5b4-4d95-a7db-4e40aa0d8c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a3f55c9-6b49-4c3c-9307-323c41e54164', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:18 devstack sudo[108872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d 1073741824 Aug 09 13:00:18 devstack sudo[108872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db679cf8-726c-46ce-b2b9-6c306233402a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:18 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Volume volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 (6a3f55c9-6b49-4c3c-9307-323c41e54164): created successfully Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db679cf8-726c-46ce-b2b9-6c306233402a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Flow 'volume_create_manager' (1aeff87c-01a1-4a6d-88da-555cab84fc0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:18 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-528e4802-02ea-49ee-bbe1-ffd4ff26b375 tempest-ProjectReaderTests-201724270 None] Created volume successfully. Aug 09 13:00:18 devstack sudo[108868]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-31954253-c319-44f9-bbb5-e685869e3ca3" returned: 0 in 0.289s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:18 devstack sudo[108865]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60aabf87-5d34-45d9-8120-129940aaf5f1_isnzkkky" returned: 1 in 0.366s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_60aabf87-5d34-45d9-8120-129940aaf5f1_isnzkkky' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-quobyte-31954253-c319-44f9-bbb5-e685869e3ca3" released by "delete_volume" :: held 0.769s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[05a95719-b077-4bdb-9e86-08e56cf5bebe]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Created reservations ['d8ae7eaa-e1b3-43d1-b4d3-e76bf2d3d70a', '7467b2b5-dab4-4e66-8ebe-ba52a6d7eb4a', '82befbf0-e2a7-4cd0-9a9f-0ccb2ef1a277', '5b01cba1-4872-412e-afb6-ac10ebaa7f05'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:18 devstack sudo[108877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD Aug 09 13:00:18 devstack sudo[108877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:18 devstack sudo[108882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:18 devstack sudo[108882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:18 devstack sudo[108872]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d 1073741824" returned: 0 in 0.510s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:18 devstack sudo[108877]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD" returned: 0 in 0.389s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:18 devstack sudo[108888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d Aug 09 13:00:18 devstack sudo[108888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:18 devstack sudo[108882]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.306s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:18 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Deleted volume successfully. Aug 09 13:00:18 devstack sudo[108887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD Aug 09 13:00:18 devstack sudo[108887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-73f276d0-e032-4b8b-b184-c7cda0686ebd tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-31954253-c319-44f9-bbb5-e685869e3ca3-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:19 devstack sudo[108888]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d" returned: 0 in 0.279s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] <== create_volume: return (842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Attempting download of 6ff78725-4cb9-4565-941c-f652007bf0ad ((None, [{'url': 'file:///opt/stack/data/glance/images/6ff78725-4cb9-4565-941c-f652007bf0ad', 'metadata': {}}])) to volume 24f35485-7442-48b2-953d-ded58c33878d. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Aug 09 13:00:19 devstack sudo[108887]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD" returned: 1 in 0.350s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] 60aabf87-5d34-45d9-8120-129940aaf5f1 was raw, converting to qcow2 {{(pid=89309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:19 devstack sudo[108896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 Aug 09 13:00:19 devstack sudo[108896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[13565b57-c5ee-4e2a-b374-bfd78e8f6891]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ff78725-4cb9-4565-941c-f652007bf0ad_1aevvild {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:19 devstack sudo[108898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ff78725-4cb9-4565-941c-f652007bf0ad_1aevvild Aug 09 13:00:19 devstack sudo[108898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] Creating offline snapshot 8afb9981-2d84-413d-b081-9c905c9d2fbd of volume 6a3f55c9-6b49-4c3c-9307-323c41e54164 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ec2f6d-93f8-4100-843b-10604ce07513]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:19 devstack sudo[108898]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6ff78725-4cb9-4565-941c-f652007bf0ad_1aevvild" returned: 0 in 0.381s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ff78725-4cb9-4565-941c-f652007bf0ad_1aevvild {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "cinder-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "cinder-quobyte-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-quobyte-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd" acquired by "delete_volume" :: waited 0.025s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:19 devstack sudo[108905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 Aug 09 13:00:19 devstack sudo[108905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a718e9-e7f4-4ce2-b799-3608ac0eac64]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:19 devstack sudo[108906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ff78725-4cb9-4565-941c-f652007bf0ad_1aevvild Aug 09 13:00:19 devstack sudo[108906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:19 devstack sudo[108896]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712" returned: 0 in 0.625s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_60aabf87-5d34-45d9-8120-129940aaf5f1_6hpd8j20devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 13:00:19 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Converted 0.00 MB image at 0.00 MB/s Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:19 devstack sudo[108910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 1G Aug 09 13:00:19 devstack sudo[108910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:19 devstack sudo[108908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd Aug 09 13:00:19 devstack sudo[108908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:19 devstack sudo[108906]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ff78725-4cb9-4565-941c-f652007bf0ad_1aevvild" returned: 1 in 0.396s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6ff78725-4cb9-4565-941c-f652007bf0ad_1aevvild' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f63a85a-094a-4545-8213-c3b356c088b8]: (4, 'raw') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:19 devstack sudo[108905]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164" returned: 0 in 0.445s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:19 devstack sudo[108920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd 1G Aug 09 13:00:19 devstack sudo[108920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:20 devstack sudo[108919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD Aug 09 13:00:20 devstack sudo[108919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:20 devstack sudo[108908]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd" returned: 0 in 0.424s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:20 devstack sudo[108910]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 1G" returned: 0 in 0.378s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Downloaded image 60aabf87-5d34-45d9-8120-129940aaf5f1 ((None, [{'url': 'file:///opt/stack/data/glance/images/60aabf87-5d34-45d9-8120-129940aaf5f1', 'metadata': {}}])) to volume 96d48c72-58fb-4150-bdaa-5f052d351712 successfully. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Temporary image 60aabf87-5d34-45d9-8120-129940aaf5f1 for user 342047c0c8514ff388dcd350bb622bff is deleted. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Marking volume 96d48c72-58fb-4150-bdaa-5f052d351712 as bootable. {{(pid=89309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 13:00:20 devstack sudo[108930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd Aug 09 13:00:20 devstack sudo[108930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Copying metadata from image 60aabf87-5d34-45d9-8120-129940aaf5f1 to 96d48c72-58fb-4150-bdaa-5f052d351712. {{(pid=89309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Creating volume glance metadata for volume 96d48c72-58fb-4150-bdaa-5f052d351712 backed by image 60aabf87-5d34-45d9-8120-129940aaf5f1 with: {'image_id': '60aabf87-5d34-45d9-8120-129940aaf5f1', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '7535cd5aac76da3b3c7583d06dd26e37', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9c48a44-95f1-4fdd-808c-7d7a0304cb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96d48c72-58fb-4150-bdaa-5f052d351712', 'volume_size': 1, 'image_id': '60aabf87-5d34-45d9-8120-129940aaf5f1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/60aabf87-5d34-45d9-8120-129940aaf5f1', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '7535cd5aac76da3b3c7583d06dd26e37', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'c056551e336c4060b55adff40d236089', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cca1bd4f67fa0051f1e2427d7619cf4720fcfe13c0c9f59d2074bd419b09cbb7840df65706696e3f32f8a9786a931750c3399bd19d311b5430969f231aeb54ed', 'id': '60aabf87-5d34-45d9-8120-129940aaf5f1', 'created_at': datetime.datetime(2026, 8, 9, 11, 0, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 11, 0, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/60aabf87-5d34-45d9-8120-129940aaf5f1/file', 'properties': {}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596e669c-5087-49ed-a94a-c193ed9aac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:20 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Volume volume-96d48c72-58fb-4150-bdaa-5f052d351712 (96d48c72-58fb-4150-bdaa-5f052d351712): created successfully Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (596e669c-5087-49ed-a94a-c193ed9aac61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Flow 'volume_create_manager' (f8c8ad17-90c8-4f5f-bedf-312330e0ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:20 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-97740204-0f69-44b7-b6e9-ed8fa5428239 tempest-VolumeImageDependencyTests-609184162 None] Created volume successfully. Aug 09 13:00:20 devstack sudo[108919]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:20 devstack sudo[108930]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd" returned: 0 in 0.300s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-quobyte-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd" released by "delete_volume" :: held 0.776s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:20 devstack sudo[108920]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd 1G" returned: 0 in 0.510s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:20 devstack sudo[108938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD Aug 09 13:00:20 devstack sudo[108938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:20 devstack sudo[108941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd Aug 09 13:00:20 devstack sudo[108941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Created reservations ['054ffdfd-42c6-4e24-9144-2e87f258a70d', '2a27fb33-2fa9-425e-8760-0e5aa3776ebb', '2f64cf6d-bffe-4c44-b6c7-8ca3debd6e12', '8d0aab42-5899-44be-9c52-8228543ff5b9'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:20 devstack sudo[108944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:20 devstack sudo[108944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "cinder-7b1976ad-e785-49b2-8a95-5807b2f7e050-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:20 devstack sudo[108938]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD" returned: 1 in 0.410s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD' failed. Not Retrying. {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] 6ff78725-4cb9-4565-941c-f652007bf0ad was raw, converting to qcow2 {{(pid=89309) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-7b1976ad-e785-49b2-8a95-5807b2f7e050-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:20 devstack sudo[108952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d Aug 09 13:00:20 devstack sudo[108952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:20 devstack sudo[108941]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd" returned: 0 in 0.404s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:20 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd is being set with open permissions: ugo+rw Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:20 devstack sudo[108944]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "cinder-quobyte-7b1976ad-e785-49b2-8a95-5807b2f7e050" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.335s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:20 devstack sudo[108955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd Aug 09 13:00:20 devstack sudo[108955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:20 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Deleted volume successfully. Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-quobyte-7b1976ad-e785-49b2-8a95-5807b2f7e050" acquired by "delete_volume" :: waited 0.033s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Acquiring lock "cinder-96d48c72-58fb-4150-bdaa-5f052d351712-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aa5536-8145-41e1-9203-41a4cbbea005]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7b1976ad-e785-49b2-8a95-5807b2f7e050 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Lock "cinder-96d48c72-58fb-4150-bdaa-5f052d351712-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5c800a96-d0c3-4bf5-93cc-9591cb99e2cb tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-d2bd1206-1894-4e83-b7e0-5c06f12bb6dd-delete_volume" released by "delete_volume" :: held 1.441s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Acquiring lock "cinder-quobyte-96d48c72-58fb-4150-bdaa-5f052d351712" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Lock "cinder-quobyte-96d48c72-58fb-4150-bdaa-5f052d351712" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0dd48a9-189b-40ff-81a3-67620cfc344a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:21 devstack sudo[108957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7b1976ad-e785-49b2-8a95-5807b2f7e050 Aug 09 13:00:21 devstack sudo[108957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:21 devstack sudo[108955]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd" returned: 0 in 0.352s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:21 devstack sudo[108961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 Aug 09 13:00:21 devstack sudo[108961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:21 devstack sudo[108964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.info Aug 09 13:00:21 devstack sudo[108964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:21 devstack sudo[108952]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d" returned: 0 in 0.727s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6ff78725-4cb9-4565-941c-f652007bf0ad_ff__e1c7devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 13:00:21 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Converted 0.00 MB image at 0.00 MB/s Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:21 devstack sudo[108972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d 1G Aug 09 13:00:21 devstack sudo[108972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:21 devstack sudo[108957]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7b1976ad-e785-49b2-8a95-5807b2f7e050" returned: 0 in 0.612s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7b1976ad-e785-49b2-8a95-5807b2f7e050 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:21 devstack sudo[108977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7b1976ad-e785-49b2-8a95-5807b2f7e050 Aug 09 13:00:21 devstack sudo[108977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:21 devstack sudo[108961]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:21 devstack sudo[108964]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.info" returned: 0 in 0.390s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:21 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.info is being set with open permissions: ugo+rw Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712" returned: 0 in 0.534s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:21 devstack sudo[108981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.info Aug 09 13:00:21 devstack sudo[108981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:21 devstack sudo[108982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712 Aug 09 13:00:21 devstack sudo[108982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:21 devstack sudo[108977]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7b1976ad-e785-49b2-8a95-5807b2f7e050" returned: 0 in 0.275s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-quobyte-7b1976ad-e785-49b2-8a95-5807b2f7e050" released by "delete_volume" :: held 0.955s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:21 devstack sudo[108972]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d 1G" returned: 0 in 0.407s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Downloaded image 6ff78725-4cb9-4565-941c-f652007bf0ad ((None, [{'url': 'file:///opt/stack/data/glance/images/6ff78725-4cb9-4565-941c-f652007bf0ad', 'metadata': {}}])) to volume 24f35485-7442-48b2-953d-ded58c33878d successfully. {{(pid=89309) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Temporary image 6ff78725-4cb9-4565-941c-f652007bf0ad for user 08cd067098774fb8a2bba780812374ea is deleted. {{(pid=89309) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG cinder.volume.volume_utils [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Marking volume 24f35485-7442-48b2-953d-ded58c33878d as bootable. {{(pid=89309) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Aug 09 13:00:21 devstack sudo[108981]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.info" returned: 0 in 0.285s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.505s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Copying metadata from image 6ff78725-4cb9-4565-941c-f652007bf0ad to 24f35485-7442-48b2-953d-ded58c33878d. {{(pid=89309) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Creating volume glance metadata for volume 24f35485-7442-48b2-953d-ded58c33878d backed by image 6ff78725-4cb9-4565-941c-f652007bf0ad with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '6ff78725-4cb9-4565-941c-f652007bf0ad', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '357d714cb4e1323d79c7575b0b7d166e', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=89309) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Aug 09 13:00:21 devstack sudo[108982]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96d48c72-58fb-4150-bdaa-5f052d351712" returned: 0 in 0.306s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Created reservations ['8ee88445-6369-4e42-b100-db4e29d3d049', 'cad6b2d5-96e0-4302-b7a4-3c3cdbf99114', '566018ac-c0e3-48cf-be49-c2a165759ffe', 'e72b26bd-1981-44d9-ae1d-c0981843a94b'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Lock "cinder-quobyte-96d48c72-58fb-4150-bdaa-5f052d351712" released by "delete_volume" :: held 0.898s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-fdef1aae-1f36-4e5d-8d43-d2840081e625 tempest-ProjectReaderTests-201724270 None] Create snapshot completed successfully Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9ca0ed5-52ec-47ba-9335-11df1896d00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f35485-7442-48b2-953d-ded58c33878d', 'volume_size': 1, 'image_id': '6ff78725-4cb9-4565-941c-f652007bf0ad', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6ff78725-4cb9-4565-941c-f652007bf0ad', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '357d714cb4e1323d79c7575b0b7d166e', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3de8eaa098dc4b838026c5360c6aa229', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1201e87728e72f95e536e3187ebb16fdbcbb90934aeb5dda842aef9e7089cef4c654c2ccebb0b7c6d65bd04ae79ee47567f552b692b9923ce9cebc450559df35', 'id': '6ff78725-4cb9-4565-941c-f652007bf0ad', 'created_at': datetime.datetime(2026, 8, 9, 11, 0, 12, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 8, 9, 11, 0, 14, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6ff78725-4cb9-4565-941c-f652007bf0ad/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43b3a9c-7773-4cbf-ae95-81d1c61d0a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:22 devstack sudo[108992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:22 devstack sudo[108992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Created reservations ['f5021e8e-9e18-4b22-b50e-c76d862d48a4', 'ae9218d9-6b51-4bd5-a90f-4f0d8529aab3', '73fc4ff1-cfeb-44a5-88e9-25b7de72fcdc', 'a28652e6-4dd7-4e02-b1ef-bbfc84daae3c'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:22 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Volume volume-24f35485-7442-48b2-953d-ded58c33878d (24f35485-7442-48b2-953d-ded58c33878d): created successfully Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e43b3a9c-7773-4cbf-ae95-81d1c61d0a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Flow 'volume_create_manager' (9f96284f-7958-4fd2-8b0a-9523a2795ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1fe58f41-f452-4c99-830a-8e54a2bb7a41 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Created volume successfully. Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:22 devstack sudo[108994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:22 devstack sudo[108994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:22 devstack sudo[108992]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.275s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Deleted volume successfully. Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-55cf8638-b532-45d7-8ea2-afb593b40cc7 tempest-CreateVolumesFromImageTest-966870949 None] Lock "cinder-7b1976ad-e785-49b2-8a95-5807b2f7e050-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:22 devstack sudo[108994]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.274s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Deleted volume successfully. Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-11cffa91-1d22-4983-8d42-39511b918b90 tempest-VolumeImageDependencyTests-609184162 None] Lock "cinder-96d48c72-58fb-4150-bdaa-5f052d351712-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Acquiring lock "cinder-24f35485-7442-48b2-953d-ded58c33878d-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Lock "cinder-24f35485-7442-48b2-953d-ded58c33878d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Acquiring lock "cinder-quobyte-24f35485-7442-48b2-953d-ded58c33878d" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Lock "cinder-quobyte-24f35485-7442-48b2-953d-ded58c33878d" acquired by "delete_volume" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[157c5b1f-5562-442e-a79b-0e1b20bb4627]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-8afb9981-2d84-413d-b081-9c905c9d2fbd-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Lock "cinder-8afb9981-2d84-413d-b081-9c905c9d2fbd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-6a3f55c9-6b49-4c3c-9307-323c41e54164" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-6a3f55c9-6b49-4c3c-9307-323c41e54164" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-8afb9981-2d84-413d-b081-9c905c9d2fbd" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:22 devstack sudo[108998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d Aug 09 13:00:22 devstack sudo[108998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-8afb9981-2d84-413d-b081-9c905c9d2fbd" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Deleting offline snapshot 8afb9981-2d84-413d-b081-9c905c9d2fbd of volume 6a3f55c9-6b49-4c3c-9307-323c41e54164 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] snapshot_file for this snap is: volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[21ddf4fd-8135-47cf-ad95-9f8b7bebf01d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:22 devstack sudo[109000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd Aug 09 13:00:22 devstack sudo[109000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:23 devstack sudo[108998]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d" returned: 0 in 0.385s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:23 devstack sudo[109005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d Aug 09 13:00:23 devstack sudo[109005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:23 devstack sudo[109000]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd" returned: 0 in 0.454s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6a3f55c9-6b49-4c3c-9307-323c41e54164(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4ae121-a57c-45d6-8add-7a58b8186ada]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:23 devstack sudo[109005]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-24f35485-7442-48b2-953d-ded58c33878d" returned: 0 in 0.308s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Lock "cinder-quobyte-24f35485-7442-48b2-953d-ded58c33878d" released by "delete_volume" :: held 0.739s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Created reservations ['9864e24c-f087-4f6a-a4ca-7cdaff936bcc', '2bbde1b4-e647-442c-91c9-e72a742465ea', '600b2736-35c6-4fae-9968-64c0cbe5d384', '421ca0b1-c606-4ad4-8c98-2997a65a7c29'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:23 devstack sudo[109011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 Aug 09 13:00:23 devstack sudo[109011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:23 devstack sudo[109013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:23 devstack sudo[109013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:23 devstack sudo[109013]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.315s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:23 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Deleted volume successfully. Aug 09 13:00:23 devstack sudo[109011]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164" returned: 0 in 0.586s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d5b3b16d-7d47-4056-9f2a-11ba330f8371 tempest-VolumeAndVolumeTypeFromImageTest-1166632304 None] Lock "cinder-24f35485-7442-48b2-953d-ded58c33878d-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:24 devstack sudo[109020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd Aug 09 13:00:24 devstack sudo[109020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:24 devstack sudo[109020]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd" returned: 0 in 0.563s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:24 devstack sudo[109026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd Aug 09 13:00:24 devstack sudo[109026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:24 devstack sudo[109026]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164.8afb9981-2d84-413d-b081-9c905c9d2fbd" returned: 0 in 0.349s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-8afb9981-2d84-413d-b081-9c905c9d2fbd" released by "_delete_snapshot" :: held 2.065s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-6a3f55c9-6b49-4c3c-9307-323c41e54164" released by "delete_snapshot" :: held 2.095s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:25 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Created reservations ['20e02cc6-2f0e-46f2-a675-072ea198700c', '71941bb3-ac38-4597-81aa-824993bb919a', '75a33f23-1902-49f5-ab22-25336ec9d73b', '7d97a6ff-fcb5-45fa-bcbf-fe4c7dbffc0c'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:25 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Delete snapshot completed successfully. Aug 09 13:00:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b8bceb79-7da0-46d9-931f-dc3ea6f71571 tempest-ProjectReaderTests-201724270 None] Lock "cinder-8afb9981-2d84-413d-b081-9c905c9d2fbd-delete_snapshot" released by "delete_snapshot" :: held 2.311s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-6a3f55c9-6b49-4c3c-9307-323c41e54164-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Lock "cinder-6a3f55c9-6b49-4c3c-9307-323c41e54164-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-6a3f55c9-6b49-4c3c-9307-323c41e54164" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:26 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-6a3f55c9-6b49-4c3c-9307-323c41e54164" acquired by "delete_volume" :: waited 0.029s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:26 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f722ac1d-106f-442b-a33f-f698b9f09f02]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:26 devstack sudo[109029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 Aug 09 13:00:26 devstack sudo[109029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:26 devstack sudo[109029]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164" returned: 0 in 0.472s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:26 devstack sudo[109034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164 Aug 09 13:00:26 devstack sudo[109034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:27 devstack sudo[109034]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-6a3f55c9-6b49-4c3c-9307-323c41e54164" returned: 0 in 0.331s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-6a3f55c9-6b49-4c3c-9307-323c41e54164" released by "delete_volume" :: held 0.899s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Created reservations ['dd46364e-5a7c-42aa-8418-28ecf21d26a7', 'e68d3040-292f-45dd-b70f-24b14f795fbf', 'c17ca199-0813-4610-88fb-464d0c5a8389', 'ea05be36-081a-454c-a22e-893bacfa63af'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:27 devstack sudo[109037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:27 devstack sudo[109037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Flow 'volume_create_manager' (2cb29952-adad-4c17-9a09-c0103d82279b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e60a840-475e-43fc-b5eb-ddc81c74ac35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e60a840-475e-43fc-b5eb-ddc81c74ac35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601235979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139eb3ba-8932-4f2f-bd4c-fc400b5c584a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c3cc18881744d09ba10bac3b3fede8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:27Z,use_quota=True,user_id='11b4e82fcf3d4eb2ab453b36b6b0003f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6153b9-1c48-4f66-93c6-1cb344422959) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6153b9-1c48-4f66-93c6-1cb344422959) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76503bf3-1809-465e-9aac-ac900f078402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76503bf3-1809-465e-9aac-ac900f078402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '139eb3ba-8932-4f2f-bd4c-fc400b5c584a', 'volume_name': 'volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636f4a2d-8c8b-4bb7-892d-9b6e41437094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (636f4a2d-8c8b-4bb7-892d-9b6e41437094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7806da1a-f0b9-4293-800b-f659facf5b76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:27 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume 139eb3ba-8932-4f2f-bd4c-fc400b5c584a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a', 'volume_size': 1} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1601235979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=139eb3ba-8932-4f2f-bd4c-fc400b5c584a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c3cc18881744d09ba10bac3b3fede8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:27Z,use_quota=True,user_id='11b4e82fcf3d4eb2ab453b36b6b0003f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Creating volume 139eb3ba-8932-4f2f-bd4c-fc400b5c584a {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:27 devstack sudo[109037]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:27 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.371s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:27 devstack sudo[109040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a 1073741824 Aug 09 13:00:27 devstack sudo[109040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Flow 'volume_create_manager' (1d2cc38d-ccf0-4eb1-9a12-a97f1e31e25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f108866-323f-4edc-83b7-8e8cdd435a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:27 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Deleted volume successfully. Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f108866-323f-4edc-83b7-8e8cdd435a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa6b3da-5d36-40cd-9e53-4587f7c32db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5d5a022c304436bf4bbdfc7d831541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:27Z,use_quota=True,user_id='3d70698449a74f4f929d2de85d009a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2660c563-268a-49b6-9e95-6e88af6912c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2660c563-268a-49b6-9e95-6e88af6912c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6be0ce0-7c13-400d-9979-0de7ad3b1b64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6be0ce0-7c13-400d-9979-0de7ad3b1b64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afa6b3da-5d36-40cd-9e53-4587f7c32db2', 'volume_name': 'volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b928f1f-5d6b-4ab1-a1a0-7dcaf8349f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b928f1f-5d6b-4ab1-a1a0-7dcaf8349f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adac6b4-ea1b-492f-b02b-a39621c8d485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:27 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Volume afa6b3da-5d36-40cd-9e53-4587f7c32db2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2', 'volume_size': 1} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8f90e2fe-9cd2-4ddd-9c00-b2b2cc4289d2 tempest-ProjectReaderTests-201724270 None] Lock "cinder-6a3f55c9-6b49-4c3c-9307-323c41e54164-delete_volume" released by "delete_volume" :: held 1.716s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Flow 'volume_create_manager' (dd4b5eb3-b3d7-42eb-870e-a5dcbac81409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104ae2b4-6af3-4c08-b614-9de29b79b520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104ae2b4-6af3-4c08-b614-9de29b79b520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-968897089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0209a0ec-112e-4e0d-91a0-f8a57116d20d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f33e25b5e8a490fb86c172de4f7657b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:28Z,use_quota=True,user_id='dedbff7bb09a47de8ad4758bdcc8e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6476c55-9f89-4619-b7e1-7e3dabf5f65a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6476c55-9f89-4619-b7e1-7e3dabf5f65a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59adcdd-ba09-4d25-a536-1317f1873826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b59adcdd-ba09-4d25-a536-1317f1873826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0209a0ec-112e-4e0d-91a0-f8a57116d20d', 'volume_name': 'volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9112f7cc-962b-4ae4-9f5e-510291fe6e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9112f7cc-962b-4ae4-9f5e-510291fe6e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4d070d-25f4-41e8-94a4-bfee9df575eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:28 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Volume 0209a0ec-112e-4e0d-91a0-f8a57116d20d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d', 'volume_size': 1} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:28 devstack sudo[109040]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a 1073741824" returned: 0 in 0.558s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:28 devstack sudo[109046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a Aug 09 13:00:28 devstack sudo[109046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:28 devstack sudo[109046]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a" returned: 0 in 0.281s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.716s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afa6b3da-5d36-40cd-9e53-4587f7c32db2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5d5a022c304436bf4bbdfc7d831541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:27Z,use_quota=True,user_id='3d70698449a74f4f929d2de85d009a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Creating volume afa6b3da-5d36-40cd-9e53-4587f7c32db2 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:28 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:28 devstack sudo[109049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2 1073741824 Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7806da1a-f0b9-4293-800b-f659facf5b76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:28 devstack sudo[109049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0ef9d0-9d47-4543-81be-51638459ac36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:28 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a (139eb3ba-8932-4f2f-bd4c-fc400b5c584a): created successfully Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da0ef9d0-9d47-4543-81be-51638459ac36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Flow 'volume_create_manager' (2cb29952-adad-4c17-9a09-c0103d82279b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:28 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d5c05ecb-e7d1-45d1-b75a-f78a8cc80ad3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Created volume successfully. Aug 09 13:00:28 devstack sudo[109049]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2 1073741824" returned: 0 in 0.465s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:29 devstack sudo[109055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2 Aug 09 13:00:29 devstack sudo[109055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:29 devstack sudo[109055]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2" returned: 0 in 0.264s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.217s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-968897089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0209a0ec-112e-4e0d-91a0-f8a57116d20d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f33e25b5e8a490fb86c172de4f7657b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:28Z,use_quota=True,user_id='dedbff7bb09a47de8ad4758bdcc8e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Creating volume 0209a0ec-112e-4e0d-91a0-f8a57116d20d {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:29 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:29 devstack sudo[109058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d 1073741824 Aug 09 13:00:29 devstack sudo[109058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5adac6b4-ea1b-492f-b02b-a39621c8d485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40051375-d7ae-4d1e-99f3-1a19525d296c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:29 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Volume volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2 (afa6b3da-5d36-40cd-9e53-4587f7c32db2): created successfully Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40051375-d7ae-4d1e-99f3-1a19525d296c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Flow 'volume_create_manager' (1d2cc38d-ccf0-4eb1-9a12-a97f1e31e25f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Flow 'volume_create_manager' (15fb2977-5254-4281-9b50-d292b1c43815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7bc887-a30f-4bef-8107-edb7e76e0baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e7bc887-a30f-4bef-8107-edb7e76e0baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1663842679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de23e204-e7c1-4307-91ae-f4b373460a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f8a83bc5047daa1931a035867059e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:29Z,use_quota=True,user_id='cec1f281a66b482c9a040ee70a00b2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d126ebcf-2c7c-435d-952c-4fb16654a55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d126ebcf-2c7c-435d-952c-4fb16654a55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb934ca-13f2-4eac-8899-e77bd9f94be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (feb934ca-13f2-4eac-8899-e77bd9f94be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de23e204-e7c1-4307-91ae-f4b373460a44', 'volume_name': 'volume-de23e204-e7c1-4307-91ae-f4b373460a44', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c243695-f28d-49f9-8a47-bbe3b624a7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c243695-f28d-49f9-8a47-bbe3b624a7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b82c07-df71-483f-b985-841e4790f4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:29 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume de23e204-e7c1-4307-91ae-f4b373460a44: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de23e204-e7c1-4307-91ae-f4b373460a44', 'volume_size': 1} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:29 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ac8183c7-e998-4959-bd7e-618b918e0630 tempest-CinderUnicodeTest-402267638 None] Created volume successfully. Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:29 devstack sudo[109058]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d 1073741824" returned: 0 in 0.463s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:29 devstack sudo[109063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d Aug 09 13:00:29 devstack sudo[109063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:30 devstack sudo[109063]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d" returned: 0 in 0.249s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.571s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1663842679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de23e204-e7c1-4307-91ae-f4b373460a44,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f8a83bc5047daa1931a035867059e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:29Z,use_quota=True,user_id='cec1f281a66b482c9a040ee70a00b2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Creating volume de23e204-e7c1-4307-91ae-f4b373460a44 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:30 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de23e204-e7c1-4307-91ae-f4b373460a44 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae4d070d-25f4-41e8-94a4-bfee9df575eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:30 devstack sudo[109066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de23e204-e7c1-4307-91ae-f4b373460a44 1073741824 Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7314c7e7-2d8e-4ac7-a737-0aed10d3f286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:30 devstack sudo[109066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:30 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Volume volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d (0209a0ec-112e-4e0d-91a0-f8a57116d20d): created successfully Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7314c7e7-2d8e-4ac7-a737-0aed10d3f286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Flow 'volume_create_manager' (dd4b5eb3-b3d7-42eb-870e-a5dcbac81409) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:30 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2dc01747-96b8-494f-9df4-e2fcfdd678e7 tempest-ProjectReaderTests-201724270 None] Created volume successfully. Aug 09 13:00:30 devstack sudo[109066]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de23e204-e7c1-4307-91ae-f4b373460a44 1073741824" returned: 0 in 0.454s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de23e204-e7c1-4307-91ae-f4b373460a44 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:30 devstack sudo[109072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de23e204-e7c1-4307-91ae-f4b373460a44 Aug 09 13:00:30 devstack sudo[109072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:30 devstack sudo[109072]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de23e204-e7c1-4307-91ae-f4b373460a44" returned: 0 in 0.260s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] <== create_volume: return (752ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.218s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3b82c07-df71-483f-b985-841e4790f4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de23e204-e7c1-4307-91ae-f4b373460a44', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef3afa5-25e9-48e8-908d-a5fa83b73f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Creating offline snapshot db666070-e6bd-42f8-9405-3b36f044fa1e of volume 139eb3ba-8932-4f2f-bd4c-fc400b5c584a {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1999cf8c-24a2-49bd-9bfc-c3fbd31981f0]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:30 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume volume-de23e204-e7c1-4307-91ae-f4b373460a44 (de23e204-e7c1-4307-91ae-f4b373460a44): created successfully Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bef3afa5-25e9-48e8-908d-a5fa83b73f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Flow 'volume_create_manager' (15fb2977-5254-4281-9b50-d292b1c43815) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:30 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-3d6b08d0-57ae-4f1a-b3bc-e2fff4a71ef0 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Created volume successfully. Aug 09 13:00:30 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:31 devstack sudo[109075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a Aug 09 13:00:31 devstack sudo[109075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Flow 'volume_create_manager' (022d93e8-08d5-473f-b6d7-a49fc9b97260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ac0821-795d-4cb9-ad00-e0c9cb626e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8ac0821-795d-4cb9-ad00-e0c9cb626e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1695739539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b85f93b-d6ec-4538-a83c-122dcda95d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5d5a022c304436bf4bbdfc7d831541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:31Z,use_quota=True,user_id='3d70698449a74f4f929d2de85d009a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3346cd66-8a2e-464c-bd81-279ebca8cb70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3346cd66-8a2e-464c-bd81-279ebca8cb70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cbd7fe-00e4-4943-a2c4-3e34642860cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02cbd7fe-00e4-4943-a2c4-3e34642860cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b85f93b-d6ec-4538-a83c-122dcda95d5d', 'volume_name': 'volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a6558f-d63f-4a90-a2e2-7b156449d677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e6a6558f-d63f-4a90-a2e2-7b156449d677) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6b88bf-4308-4569-864f-4a1faee028fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:31 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Volume 0b85f93b-d6ec-4538-a83c-122dcda95d5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d', 'volume_size': 1} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:31 devstack sudo[109075]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a" returned: 0 in 0.382s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:31 devstack sudo[109080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e 1G Aug 09 13:00:31 devstack sudo[109080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:31 devstack sudo[109080]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e 1G" returned: 0 in 0.429s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:31 devstack sudo[109086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e Aug 09 13:00:31 devstack sudo[109086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Flow 'volume_create_manager' (002c276e-48be-40d0-9a5c-89f0c7dd3b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c40e00-22a4-4e05-8130-715acab2286a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21c40e00-22a4-4e05-8130-715acab2286a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-454875824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc9a167-0927-4e73-b6b9-d853f3402601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f8a83bc5047daa1931a035867059e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:32Z,use_quota=True,user_id='cec1f281a66b482c9a040ee70a00b2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ab27fd-2eb5-48fb-aa0e-a02a5ad50e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7ab27fd-2eb5-48fb-aa0e-a02a5ad50e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07eb290-52f9-4b99-8836-496c3c195659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d07eb290-52f9-4b99-8836-496c3c195659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acc9a167-0927-4e73-b6b9-d853f3402601', 'volume_name': 'volume-acc9a167-0927-4e73-b6b9-d853f3402601', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d46b972-b413-4dd4-bf17-c248a366b91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d46b972-b413-4dd4-bf17-c248a366b91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798e0a13-82f4-477d-a2b9-ca62b9e59d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:32 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume acc9a167-0927-4e73-b6b9-d853f3402601: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acc9a167-0927-4e73-b6b9-d853f3402601', 'volume_size': 1} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:32 devstack sudo[109086]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e" returned: 0 in 0.343s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:32 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e is being set with open permissions: ugo+rw Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:32 devstack sudo[109091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e Aug 09 13:00:32 devstack sudo[109091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Flow 'volume_create_manager' (ccd02983-8ed6-47a8-9be9-5c6373d71ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cc9220-9d66-4378-b1a0-d9964842a58b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cc9220-9d66-4378-b1a0-d9964842a58b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1416377124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f8a83bc5047daa1931a035867059e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:32Z,use_quota=True,user_id='cec1f281a66b482c9a040ee70a00b2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4200cf2-d21c-470c-a945-f9e13aeb30eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4200cf2-d21c-470c-a945-f9e13aeb30eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:32 devstack sudo[109091]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f290926-fff2-4292-97a0-25679ccad6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f290926-fff2-4292-97a0-25679ccad6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c', 'volume_name': 'volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf42b47-f26b-4990-977a-330c369a7a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bf42b47-f26b-4990-977a-330c369a7a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190dfb3c-21bd-4477-b646-66d50fb31cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:32 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c', 'volume_size': 1} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e" returned: 0 in 0.321s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:32 devstack sudo[109094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.info Aug 09 13:00:32 devstack sudo[109094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Flow 'volume_create_manager' (8d1107e0-efd6-45a4-a69a-c07176c20699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff42f3a6-094a-4f9a-8a43-2473db0d15bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:32 devstack sudo[109094]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.info" returned: 0 in 0.297s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:32 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.info is being set with open permissions: ugo+rw Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff42f3a6-094a-4f9a-8a43-2473db0d15bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-930217888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90dbbef7-eefe-4cc0-82b5-00dc5ce097de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f8a83bc5047daa1931a035867059e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:33Z,use_quota=True,user_id='cec1f281a66b482c9a040ee70a00b2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:32 devstack sudo[109097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.info Aug 09 13:00:32 devstack sudo[109097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17fe0c4c-4d19-4fe5-b9d8-9a0f58a62a4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17fe0c4c-4d19-4fe5-b9d8-9a0f58a62a4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2a59d8-af5b-4c5f-95b3-8b86d644ee3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c2a59d8-af5b-4c5f-95b3-8b86d644ee3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90dbbef7-eefe-4cc0-82b5-00dc5ce097de', 'volume_name': 'volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c481f663-a75f-46c5-8109-0bbf0dc81e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c481f663-a75f-46c5-8109-0bbf0dc81e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8b16b3-4a21-4264-b904-2a493879bd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:32 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume 90dbbef7-eefe-4cc0-82b5-00dc5ce097de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de', 'volume_size': 1} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:32 devstack sudo[109097]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.info" returned: 0 in 0.275s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.918s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:31Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1695739539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b85f93b-d6ec-4538-a83c-122dcda95d5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dd5d5a022c304436bf4bbdfc7d831541',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:31Z,use_quota=True,user_id='3d70698449a74f4f929d2de85d009a07',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Creating volume 0b85f93b-d6ec-4538-a83c-122dcda95d5d {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:33 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:33 devstack sudo[109100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d 1073741824 Aug 09 13:00:33 devstack sudo[109100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:33 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-aff6678c-8dca-4e73-ad7d-1117d13fda89 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Create snapshot completed successfully Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Flow 'volume_create_manager' (e81b4e34-1fc9-40b6-885e-3636a1d5e2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877f2dde-a1a5-4d4b-8475-7e37032775a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (877f2dde-a1a5-4d4b-8475-7e37032775a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1290999849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b23959-71a9-426a-9d29-95ce5faa2d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f8a83bc5047daa1931a035867059e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:33Z,use_quota=True,user_id='cec1f281a66b482c9a040ee70a00b2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523128ce-a6af-4d57-99fb-eea6c5c7f4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (523128ce-a6af-4d57-99fb-eea6c5c7f4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ff29cc-f1cf-462c-8e91-4a79c8efb8e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ff29cc-f1cf-462c-8e91-4a79c8efb8e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61b23959-71a9-426a-9d29-95ce5faa2d79', 'volume_name': 'volume-61b23959-71a9-426a-9d29-95ce5faa2d79', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c7759d-2554-4537-8227-e4d610040b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60c7759d-2554-4537-8227-e4d610040b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ce30c8-7290-4bee-abb3-6dbbc92d441e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:33 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume 61b23959-71a9-426a-9d29-95ce5faa2d79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61b23959-71a9-426a-9d29-95ce5faa2d79', 'volume_size': 1} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Flow 'volume_create_manager' (45777621-83b6-43ff-a7d9-722d613d7538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de6c39b-faa7-4075-8f67-b234bd71eb77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de6c39b-faa7-4075-8f67-b234bd71eb77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1475556274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d75413-5d29-41fd-9ea2-af018b8b2995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f8a83bc5047daa1931a035867059e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:33Z,use_quota=True,user_id='cec1f281a66b482c9a040ee70a00b2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fc1280-25aa-4ab5-8a65-11a47c3cd5d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93fc1280-25aa-4ab5-8a65-11a47c3cd5d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5494ff99-37bb-4649-b5a3-71a31965d811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5494ff99-37bb-4649-b5a3-71a31965d811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0d75413-5d29-41fd-9ea2-af018b8b2995', 'volume_name': 'volume-e0d75413-5d29-41fd-9ea2-af018b8b2995', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:33 devstack sudo[109100]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1610d3f0-da16-4a2e-b282-ed70bea5384b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1610d3f0-da16-4a2e-b282-ed70bea5384b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a32613-5d55-4986-a698-87fe4987e773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:33 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume e0d75413-5d29-41fd-9ea2-af018b8b2995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0d75413-5d29-41fd-9ea2-af018b8b2995', 'volume_size': 1} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d 1073741824" returned: 0 in 0.487s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:33 devstack sudo[109106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d Aug 09 13:00:33 devstack sudo[109106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:33 devstack sudo[109106]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d" returned: 0 in 0.246s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.460s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d6b88bf-4308-4569-864f-4a1faee028fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6c59f6-6967-4a36-aa67-c7f3273b9bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] Creating offline snapshot 03a0f36f-2410-47ab-bb59-64b3768dbcd3 of volume 0209a0ec-112e-4e0d-91a0-f8a57116d20d {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:00:33 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Volume volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d (0b85f93b-d6ec-4538-a83c-122dcda95d5d): created successfully Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c6c59f6-6967-4a36-aa67-c7f3273b9bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Flow 'volume_create_manager' (022d93e8-08d5-473f-b6d7-a49fc9b97260) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6dd168-f7ef-4880-8f1c-7cf5278a01f4]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:33 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-cee80660-5e70-4615-abbb-e9f837e42371 tempest-CinderUnicodeTest-402267638 None] Created volume successfully. Aug 09 13:00:33 devstack sudo[109109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d Aug 09 13:00:33 devstack sudo[109109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:34 devstack sudo[109109]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Flow 'volume_create_manager' (a94b9df0-1994-446c-85d4-5f0699c0b609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a491b9f5-37a3-4d97-9893-9c1db4be2aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d" returned: 0 in 0.464s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a491b9f5-37a3-4d97-9893-9c1db4be2aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1058673242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b50bbe0-5e10-43b4-b381-578d04f2c46d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c3cc18881744d09ba10bac3b3fede8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:34Z,use_quota=True,user_id='11b4e82fcf3d4eb2ab453b36b6b0003f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857716b3-ba81-434f-9060-4b2266bbd102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (857716b3-ba81-434f-9060-4b2266bbd102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:34 devstack sudo[109114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 1G Aug 09 13:00:34 devstack sudo[109114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01361f9e-a792-4752-97de-138854ba5a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01361f9e-a792-4752-97de-138854ba5a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b50bbe0-5e10-43b4-b381-578d04f2c46d', 'volume_name': 'volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f049cf9-c457-4659-914d-58cb9e15c32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f049cf9-c457-4659-914d-58cb9e15c32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0063d0-3175-4d54-b019-87bcc84abd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:34 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume 9b50bbe0-5e10-43b4-b381-578d04f2c46d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d', 'volume_size': 1} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Flow 'volume_create_manager' (deea44d8-7977-4bd9-9bf7-4cd83b915424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f79bdc2-3d4f-4104-937e-e5709a1e35b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f79bdc2-3d4f-4104-937e-e5709a1e35b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1291421074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37db3544-7362-4d62-ab6d-eaa95c640cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c3cc18881744d09ba10bac3b3fede8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:35Z,use_quota=True,user_id='11b4e82fcf3d4eb2ab453b36b6b0003f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecaf2292-5393-41c0-a2f7-701fcfc25c08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecaf2292-5393-41c0-a2f7-701fcfc25c08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e46cd1-81ad-4b87-9db1-106d99713557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60e46cd1-81ad-4b87-9db1-106d99713557) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37db3544-7362-4d62-ab6d-eaa95c640cd0', 'volume_name': 'volume-37db3544-7362-4d62-ab6d-eaa95c640cd0', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63739f97-352d-492f-82d3-f0c347252912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63739f97-352d-492f-82d3-f0c347252912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a74925-59be-4622-b3ac-725004ad973f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:34 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume 37db3544-7362-4d62-ab6d-eaa95c640cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37db3544-7362-4d62-ab6d-eaa95c640cd0', 'volume_size': 1} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:34 devstack sudo[109114]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 1G" returned: 0 in 0.565s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:34 devstack sudo[109120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 Aug 09 13:00:34 devstack sudo[109120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Flow 'volume_create_manager' (eedf42a3-5cd4-4e3e-b86f-26e2968fe42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac151e2-5d75-4832-a3fc-c8c6e9703615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac151e2-5d75-4832-a3fc-c8c6e9703615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1720973543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae685fba-61b0-47fb-a30f-f4981a81105a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c3cc18881744d09ba10bac3b3fede8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:35Z,use_quota=True,user_id='11b4e82fcf3d4eb2ab453b36b6b0003f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981ebda8-a619-445d-8f39-ccc299d12f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (981ebda8-a619-445d-8f39-ccc299d12f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:35 devstack sudo[109120]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9a9edf-9487-48b0-a697-5b45e10c0522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9a9edf-9487-48b0-a697-5b45e10c0522) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae685fba-61b0-47fb-a30f-f4981a81105a', 'volume_name': 'volume-ae685fba-61b0-47fb-a30f-f4981a81105a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c46332-af34-49bb-937c-79529c04fb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53c46332-af34-49bb-937c-79529c04fb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4554f5e-d1bc-40cc-a2aa-019a2e63db89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume ae685fba-61b0-47fb-a30f-f4981a81105a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae685fba-61b0-47fb-a30f-f4981a81105a', 'volume_size': 1} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3" returned: 0 in 0.343s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:35 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 is being set with open permissions: ugo+rw Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:35 devstack sudo[109125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 Aug 09 13:00:35 devstack sudo[109125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Flow 'volume_create_manager' (5d05c742-8717-4c13-b0ab-94a3298a422a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62842d07-c060-4b84-af91-54c13cdd837f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62842d07-c060-4b84-af91-54c13cdd837f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-372904838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba501de7-098d-4635-9fd0-24f885f1fca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c3cc18881744d09ba10bac3b3fede8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:35Z,use_quota=True,user_id='11b4e82fcf3d4eb2ab453b36b6b0003f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:35 devstack sudo[109125]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6002f17d-e5ec-40aa-a609-91c693667d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6002f17d-e5ec-40aa-a609-91c693667d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50bb5ad1-5f37-421e-a44b-f0b267bd1d64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50bb5ad1-5f37-421e-a44b-f0b267bd1d64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba501de7-098d-4635-9fd0-24f885f1fca3', 'volume_name': 'volume-ba501de7-098d-4635-9fd0-24f885f1fca3', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d18669-c1eb-4507-96ef-25a73786d154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d18669-c1eb-4507-96ef-25a73786d154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae74aa0a-63fc-48b8-bd40-7934caa75145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume ba501de7-098d-4635-9fd0-24f885f1fca3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba501de7-098d-4635-9fd0-24f885f1fca3', 'volume_size': 1} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3" returned: 0 in 0.341s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:35 devstack sudo[109128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.info Aug 09 13:00:35 devstack sudo[109128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Flow 'volume_create_manager' (82dba4b2-87dc-451a-9a89-6d00e16b19e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:35 devstack sudo[109128]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829e2f6d-a448-494d-bd0d-500caa3c993d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.info" returned: 0 in 0.279s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:35 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.info is being set with open permissions: ugo+rw Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (829e2f6d-a448-494d-bd0d-500caa3c993d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-459176758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b4370a-29d3-4a33-9265-c6164a8d4357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c3cc18881744d09ba10bac3b3fede8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:36Z,use_quota=True,user_id='11b4e82fcf3d4eb2ab453b36b6b0003f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:35 devstack sudo[109131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.info Aug 09 13:00:35 devstack sudo[109131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164f38cb-7c78-4e0b-a924-57be45269262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (164f38cb-7c78-4e0b-a924-57be45269262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9aa4167-e74d-439c-8016-b8b83ea05c8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9aa4167-e74d-439c-8016-b8b83ea05c8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96b4370a-29d3-4a33-9265-c6164a8d4357', 'volume_name': 'volume-96b4370a-29d3-4a33-9265-c6164a8d4357', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f103bad0-6eec-4a69-84e9-1a1964e71fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f103bad0-6eec-4a69-84e9-1a1964e71fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfec40d5-27b9-4707-b474-bf327bc20b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:35 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume 96b4370a-29d3-4a33-9265-c6164a8d4357: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96b4370a-29d3-4a33-9265-c6164a8d4357', 'volume_size': 1} Aug 09 13:00:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:36 devstack sudo[109131]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.info" returned: 0 in 0.261s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.155s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-454875824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acc9a167-0927-4e73-b6b9-d853f3402601,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f8a83bc5047daa1931a035867059e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:32Z,use_quota=True,user_id='cec1f281a66b482c9a040ee70a00b2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Creating volume acc9a167-0927-4e73-b6b9-d853f3402601 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:36 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-acc9a167-0927-4e73-b6b9-d853f3402601 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:36 devstack sudo[109134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-acc9a167-0927-4e73-b6b9-d853f3402601 1073741824 Aug 09 13:00:36 devstack sudo[109134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:36 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-662b0675-3b9c-4f21-9567-052e259f8503 tempest-ProjectReaderTests-201724270 None] Create snapshot completed successfully Aug 09 13:00:36 devstack sudo[109134]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-acc9a167-0927-4e73-b6b9-d853f3402601 1073741824" returned: 0 in 0.403s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-acc9a167-0927-4e73-b6b9-d853f3402601 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:36 devstack sudo[109140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-acc9a167-0927-4e73-b6b9-d853f3402601 Aug 09 13:00:36 devstack sudo[109140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-03a0f36f-2410-47ab-bb59-64b3768dbcd3-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Lock "cinder-03a0f36f-2410-47ab-bb59-64b3768dbcd3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-0209a0ec-112e-4e0d-91a0-f8a57116d20d" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-0209a0ec-112e-4e0d-91a0-f8a57116d20d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-03a0f36f-2410-47ab-bb59-64b3768dbcd3" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-03a0f36f-2410-47ab-bb59-64b3768dbcd3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Deleting offline snapshot 03a0f36f-2410-47ab-bb59-64b3768dbcd3 of volume 0209a0ec-112e-4e0d-91a0-f8a57116d20d {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] snapshot_file for this snap is: volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7a44e86-7c2a-4917-a5cf-b7d78d3e66ac]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:36 devstack sudo[109140]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-acc9a167-0927-4e73-b6b9-d853f3402601" returned: 0 in 0.255s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] <== create_volume: return (710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.503s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1416377124',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f8a83bc5047daa1931a035867059e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:32Z,use_quota=True,user_id='cec1f281a66b482c9a040ee70a00b2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Creating volume f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:36 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (798e0a13-82f4-477d-a2b9-ca62b9e59d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acc9a167-0927-4e73-b6b9-d853f3402601', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:36 devstack sudo[109144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c 1073741824 Aug 09 13:00:36 devstack sudo[109144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:36 devstack sudo[109142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36be2571-029a-4c90-89cc-ff46d415506b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:36 devstack sudo[109142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:36 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume volume-acc9a167-0927-4e73-b6b9-d853f3402601 (acc9a167-0927-4e73-b6b9-d853f3402601): created successfully Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36be2571-029a-4c90-89cc-ff46d415506b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Flow 'volume_create_manager' (002c276e-48be-40d0-9a5c-89f0c7dd3b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:36 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b3f9b89e-92f9-4e62-b83b-b19b4edf4b7e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Created volume successfully. Aug 09 13:00:37 devstack sudo[109142]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3" returned: 0 in 0.361s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6557202d-6145-4c0d-ae9d-20fab27b51ea]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:37 devstack sudo[109154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d Aug 09 13:00:37 devstack sudo[109154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:37 devstack sudo[109144]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c 1073741824" returned: 0 in 0.430s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:37 devstack sudo[109156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c Aug 09 13:00:37 devstack sudo[109156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:37 devstack sudo[109154]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d" returned: 0 in 0.368s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:37 devstack sudo[109162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 Aug 09 13:00:37 devstack sudo[109162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:37 devstack sudo[109156]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c" returned: 0 in 0.257s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.733s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.845s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-930217888',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90dbbef7-eefe-4cc0-82b5-00dc5ce097de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f8a83bc5047daa1931a035867059e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:33Z,use_quota=True,user_id='cec1f281a66b482c9a040ee70a00b2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Creating volume 90dbbef7-eefe-4cc0-82b5-00dc5ce097de {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:37 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:37 devstack sudo[109164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de 1073741824 Aug 09 13:00:37 devstack sudo[109164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190dfb3c-21bd-4477-b646-66d50fb31cd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd44236f-a951-4494-9869-9b57a048b8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:37 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c (f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c): created successfully Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd44236f-a951-4494-9869-9b57a048b8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Flow 'volume_create_manager' (ccd02983-8ed6-47a8-9be9-5c6373d71ad7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:37 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-fccacd13-7d82-4101-b7e7-2989c1cc2a50 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Created volume successfully. Aug 09 13:00:37 devstack sudo[109162]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3" returned: 0 in 0.390s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:37 devstack sudo[109172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3 Aug 09 13:00:37 devstack sudo[109172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:38 devstack sudo[109164]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de 1073741824" returned: 0 in 0.452s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:38 devstack sudo[109174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de Aug 09 13:00:38 devstack sudo[109174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:38 devstack sudo[109172]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d.03a0f36f-2410-47ab-bb59-64b3768dbcd3" returned: 0 in 0.279s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-03a0f36f-2410-47ab-bb59-64b3768dbcd3" released by "_delete_snapshot" :: held 1.505s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-0209a0ec-112e-4e0d-91a0-f8a57116d20d" released by "delete_snapshot" :: held 1.533s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Created reservations ['1062a55d-8213-433e-a6f5-96fdb00b6d4f', '9a3afe7f-9b22-43f0-a308-a794adbc595d', 'f5d71ceb-0179-4735-8179-8cafa1967e75', '94bb22cd-fad3-4144-9c0b-bcc785dd0af5'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:38 devstack sudo[109174]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de" returned: 0 in 0.260s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.202s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1290999849',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61b23959-71a9-426a-9d29-95ce5faa2d79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f8a83bc5047daa1931a035867059e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:33Z,use_quota=True,user_id='cec1f281a66b482c9a040ee70a00b2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Creating volume 61b23959-71a9-426a-9d29-95ce5faa2d79 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:38 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-61b23959-71a9-426a-9d29-95ce5faa2d79 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c8b16b3-4a21-4264-b904-2a493879bd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:38 devstack sudo[109178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-61b23959-71a9-426a-9d29-95ce5faa2d79 1073741824 Aug 09 13:00:38 devstack sudo[109178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5651b41-d08e-43fa-a30f-55dd3de3592a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:38 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de (90dbbef7-eefe-4cc0-82b5-00dc5ce097de): created successfully Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5651b41-d08e-43fa-a30f-55dd3de3592a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Flow 'volume_create_manager' (8d1107e0-efd6-45a4-a69a-c07176c20699) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:38 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Delete snapshot completed successfully. Aug 09 13:00:38 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1bb7bacb-3184-46a2-8703-53f6e546f170 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Created volume successfully. Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c3b5b328-29a3-4d35-b73c-0eba9bf5d810 tempest-ProjectReaderTests-201724270 None] Lock "cinder-03a0f36f-2410-47ab-bb59-64b3768dbcd3-delete_snapshot" released by "delete_snapshot" :: held 1.749s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:38 devstack sudo[109178]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-61b23959-71a9-426a-9d29-95ce5faa2d79 1073741824" returned: 0 in 0.440s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-61b23959-71a9-426a-9d29-95ce5faa2d79 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-0209a0ec-112e-4e0d-91a0-f8a57116d20d-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:38 devstack sudo[109183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-61b23959-71a9-426a-9d29-95ce5faa2d79 Aug 09 13:00:38 devstack sudo[109183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Lock "cinder-0209a0ec-112e-4e0d-91a0-f8a57116d20d-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-0209a0ec-112e-4e0d-91a0-f8a57116d20d" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-0209a0ec-112e-4e0d-91a0-f8a57116d20d" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fc6a2ce-e8f6-4dae-9066-5dcf61ee25b5]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:39 devstack sudo[109185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d Aug 09 13:00:39 devstack sudo[109185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:39 devstack sudo[109183]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-61b23959-71a9-426a-9d29-95ce5faa2d79" returned: 0 in 0.317s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.689s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1475556274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0d75413-5d29-41fd-9ea2-af018b8b2995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd4f8a83bc5047daa1931a035867059e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:33Z,use_quota=True,user_id='cec1f281a66b482c9a040ee70a00b2e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Creating volume e0d75413-5d29-41fd-9ea2-af018b8b2995 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:39 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e0d75413-5d29-41fd-9ea2-af018b8b2995 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77ce30c8-7290-4bee-abb3-6dbbc92d441e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61b23959-71a9-426a-9d29-95ce5faa2d79', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:39 devstack sudo[109188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e0d75413-5d29-41fd-9ea2-af018b8b2995 1073741824 Aug 09 13:00:39 devstack sudo[109188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9de0e5a-0119-42d0-8439-98cbae9ba3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:39 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume volume-61b23959-71a9-426a-9d29-95ce5faa2d79 (61b23959-71a9-426a-9d29-95ce5faa2d79): created successfully Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9de0e5a-0119-42d0-8439-98cbae9ba3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Flow 'volume_create_manager' (e81b4e34-1fc9-40b6-885e-3636a1d5e2a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:39 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a95f6b30-60d5-4126-97c5-33cecdd8e57c tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Created volume successfully. Aug 09 13:00:39 devstack sudo[109185]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d" returned: 0 in 0.378s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:39 devstack sudo[109194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d Aug 09 13:00:39 devstack sudo[109194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:39 devstack sudo[109188]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e0d75413-5d29-41fd-9ea2-af018b8b2995 1073741824" returned: 0 in 0.451s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e0d75413-5d29-41fd-9ea2-af018b8b2995 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:39 devstack sudo[109194]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0209a0ec-112e-4e0d-91a0-f8a57116d20d" returned: 0 in 0.281s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:39 devstack sudo[109200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e0d75413-5d29-41fd-9ea2-af018b8b2995 Aug 09 13:00:39 devstack sudo[109200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-0209a0ec-112e-4e0d-91a0-f8a57116d20d" released by "delete_volume" :: held 0.715s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Created reservations ['c80b36a9-c964-49c8-9cd0-3f49717071dd', '86e20287-183f-48c6-80d3-ba9d5249c509', 'ed73ff21-25f7-4177-9a03-aa1fe424d1dd', 'd9f6d493-4463-4d48-a6f2-3c389a6d34d1'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:39 devstack sudo[109202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:39 devstack sudo[109202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:39 devstack sudo[109200]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e0d75413-5d29-41fd-9ea2-af018b8b2995" returned: 0 in 0.248s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.548s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1058673242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b50bbe0-5e10-43b4-b381-578d04f2c46d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c3cc18881744d09ba10bac3b3fede8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:34Z,use_quota=True,user_id='11b4e82fcf3d4eb2ab453b36b6b0003f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Creating volume 9b50bbe0-5e10-43b4-b381-578d04f2c46d {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:39 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (58a32613-5d55-4986-a698-87fe4987e773) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0d75413-5d29-41fd-9ea2-af018b8b2995', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:39 devstack sudo[109205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d 1073741824 Aug 09 13:00:39 devstack sudo[109205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91de4938-e5f6-4524-b6bf-d2e2f7942361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:40 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Volume volume-e0d75413-5d29-41fd-9ea2-af018b8b2995 (e0d75413-5d29-41fd-9ea2-af018b8b2995): created successfully Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91de4938-e5f6-4524-b6bf-d2e2f7942361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Flow 'volume_create_manager' (45777621-83b6-43ff-a7d9-722d613d7538) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:40 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-50334adb-f896-447a-ab5a-177454cdd10e tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Created volume successfully. Aug 09 13:00:40 devstack sudo[109202]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.310s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:40 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Deleted volume successfully. Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-db85ae1e-9d40-4695-93f1-bf85f633a59b tempest-ProjectReaderTests-201724270 None] Lock "cinder-0209a0ec-112e-4e0d-91a0-f8a57116d20d-delete_volume" released by "delete_volume" :: held 1.276s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "cinder-e0d75413-5d29-41fd-9ea2-af018b8b2995-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-e0d75413-5d29-41fd-9ea2-af018b8b2995-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "cinder-quobyte-e0d75413-5d29-41fd-9ea2-af018b8b2995" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-quobyte-e0d75413-5d29-41fd-9ea2-af018b8b2995" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0f7b21-34ec-4889-884c-eaefb4d4fa32]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e0d75413-5d29-41fd-9ea2-af018b8b2995 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:40 devstack sudo[109211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e0d75413-5d29-41fd-9ea2-af018b8b2995 Aug 09 13:00:40 devstack sudo[109211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:40 devstack sudo[109205]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d 1073741824" returned: 0 in 0.616s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:40 devstack sudo[109215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d Aug 09 13:00:40 devstack sudo[109215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Flow 'volume_create_manager' (0ebef43d-5b7d-431d-94f1-7246ac7866a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bdcfe5-eb3b-447e-8fa4-ce98351207ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24bdcfe5-eb3b-447e-8fa4-ce98351207ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-464411358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a524c6de-bf85-4db0-a320-f559361e1306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f33e25b5e8a490fb86c172de4f7657b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:41Z,use_quota=True,user_id='dedbff7bb09a47de8ad4758bdcc8e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8591092d-77fd-4913-890b-ada5d33c776d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8591092d-77fd-4913-890b-ada5d33c776d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dfd92d7-bec1-4765-a51d-1a7b26fa046f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dfd92d7-bec1-4765-a51d-1a7b26fa046f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a524c6de-bf85-4db0-a320-f559361e1306', 'volume_name': 'volume-a524c6de-bf85-4db0-a320-f559361e1306', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7633f832-26fd-4884-810e-95f952479f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7633f832-26fd-4884-810e-95f952479f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f947e62-bb25-4440-93ac-fbfefe5f2ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:40 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Volume a524c6de-bf85-4db0-a320-f559361e1306: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a524c6de-bf85-4db0-a320-f559361e1306', 'volume_size': 1} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:40 devstack sudo[109211]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e0d75413-5d29-41fd-9ea2-af018b8b2995" returned: 0 in 0.449s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e0d75413-5d29-41fd-9ea2-af018b8b2995 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:40 devstack sudo[109221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e0d75413-5d29-41fd-9ea2-af018b8b2995 Aug 09 13:00:40 devstack sudo[109221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:40 devstack sudo[109215]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d" returned: 0 in 0.307s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.441s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c0063d0-3175-4d54-b019-87bcc84abd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779c9d66-a029-4fed-9253-40a6181bd889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] Creating offline snapshot c6fdaac0-486e-4923-bacb-a64c8cbdf419 of volume 0b85f93b-d6ec-4538-a83c-122dcda95d5d {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:00:40 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d (9b50bbe0-5e10-43b4-b381-578d04f2c46d): created successfully Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (779c9d66-a029-4fed-9253-40a6181bd889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Flow 'volume_create_manager' (a94b9df0-1994-446c-85d4-5f0699c0b609) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3cfec7-037f-41d8-a294-e02a01fe6e10]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:40 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-53f58acd-4a09-4cb9-aa68-42a03807c8b0 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Created volume successfully. Aug 09 13:00:41 devstack sudo[109221]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e0d75413-5d29-41fd-9ea2-af018b8b2995" returned: 0 in 0.281s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:41 devstack sudo[109224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d Aug 09 13:00:41 devstack sudo[109224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-quobyte-e0d75413-5d29-41fd-9ea2-af018b8b2995" released by "delete_volume" :: held 0.774s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Created reservations ['62f01002-a0b8-408e-810f-58e9f12547c9', 'dd84b874-d4f6-4272-b1b9-22cef81ef7f9', '763bff76-bf23-4030-9a9e-62ab86fc516d', '635aa9df-ac3f-4381-8d76-47f96fbdd7b5'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:41 devstack sudo[109227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:41 devstack sudo[109227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:41 devstack sudo[109224]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d" returned: 0 in 0.380s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:41 devstack sudo[109232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 1G Aug 09 13:00:41 devstack sudo[109232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "cinder-61b23959-71a9-426a-9d29-95ce5faa2d79-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-61b23959-71a9-426a-9d29-95ce5faa2d79-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "cinder-quobyte-61b23959-71a9-426a-9d29-95ce5faa2d79" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:41 devstack sudo[109227]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-quobyte-61b23959-71a9-426a-9d29-95ce5faa2d79" acquired by "delete_volume" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.301s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:41 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Deleted volume successfully. Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7778c6ca-e2f3-4aec-9d9e-a8a6ca660198]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-61b23959-71a9-426a-9d29-95ce5faa2d79 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0b1c4ed2-b8f2-49c6-b153-5eff03e24001 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-e0d75413-5d29-41fd-9ea2-af018b8b2995-delete_volume" released by "delete_volume" :: held 1.313s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:41 devstack sudo[109235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-61b23959-71a9-426a-9d29-95ce5faa2d79 Aug 09 13:00:41 devstack sudo[109235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:41 devstack sudo[109232]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 1G" returned: 0 in 0.447s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:41 devstack sudo[109240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 Aug 09 13:00:41 devstack sudo[109240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:41 devstack sudo[109235]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-61b23959-71a9-426a-9d29-95ce5faa2d79" returned: 0 in 0.388s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-61b23959-71a9-426a-9d29-95ce5faa2d79 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:41 devstack sudo[109245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-61b23959-71a9-426a-9d29-95ce5faa2d79 Aug 09 13:00:41 devstack sudo[109245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:42 devstack sudo[109240]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419" returned: 0 in 0.307s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:42 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 is being set with open permissions: ugo+rw Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:42 devstack sudo[109250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 Aug 09 13:00:42 devstack sudo[109250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:42 devstack sudo[109245]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-61b23959-71a9-426a-9d29-95ce5faa2d79" returned: 0 in 0.276s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-quobyte-61b23959-71a9-426a-9d29-95ce5faa2d79" released by "delete_volume" :: held 0.737s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Created reservations ['eb340056-d842-43b3-9906-d53860a502a6', '69f4c96a-5306-4a9d-a094-58e8353148b2', '9395a83c-9e09-498b-9d9d-e1732a8fc321', '04a3fa73-5a32-4a2d-a091-eb93f0b6d688'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:42 devstack sudo[109250]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419" returned: 0 in 0.275s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:42 devstack sudo[109254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:42 devstack sudo[109254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:42 devstack sudo[109256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.info Aug 09 13:00:42 devstack sudo[109256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "cinder-90dbbef7-eefe-4cc0-82b5-00dc5ce097de-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:42 devstack sudo[109254]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.274s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-90dbbef7-eefe-4cc0-82b5-00dc5ce097de-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:42 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Deleted volume successfully. Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3bbe0495-02a2-490c-8131-b836cb3e8026 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-61b23959-71a9-426a-9d29-95ce5faa2d79-delete_volume" released by "delete_volume" :: held 1.251s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "cinder-quobyte-90dbbef7-eefe-4cc0-82b5-00dc5ce097de" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-quobyte-90dbbef7-eefe-4cc0-82b5-00dc5ce097de" acquired by "delete_volume" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:42 devstack sudo[109256]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.info" returned: 0 in 0.327s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:42 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.info is being set with open permissions: ugo+rw Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8282f8d3-1786-463b-af8c-ed71d1844c42]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:42 devstack sudo[109260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.info Aug 09 13:00:42 devstack sudo[109260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:42 devstack sudo[109261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de Aug 09 13:00:42 devstack sudo[109261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:43 devstack sudo[109260]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.info" returned: 0 in 0.252s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.114s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.189s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1291421074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37db3544-7362-4d62-ab6d-eaa95c640cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c3cc18881744d09ba10bac3b3fede8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:35Z,use_quota=True,user_id='11b4e82fcf3d4eb2ab453b36b6b0003f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Creating volume 37db3544-7362-4d62-ab6d-eaa95c640cd0 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:43 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-37db3544-7362-4d62-ab6d-eaa95c640cd0 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:43 devstack sudo[109265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-37db3544-7362-4d62-ab6d-eaa95c640cd0 1073741824 Aug 09 13:00:43 devstack sudo[109265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:43 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-7b50ae6f-e009-4179-b68b-55649edbe3ad tempest-CinderUnicodeTest-402267638 None] Create snapshot completed successfully Aug 09 13:00:43 devstack sudo[109261]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de" returned: 0 in 0.381s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:43 devstack sudo[109270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de Aug 09 13:00:43 devstack sudo[109270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:43 devstack sudo[109270]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-90dbbef7-eefe-4cc0-82b5-00dc5ce097de" returned: 0 in 0.257s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-quobyte-90dbbef7-eefe-4cc0-82b5-00dc5ce097de" released by "delete_volume" :: held 0.681s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Created reservations ['c733b222-aaed-4fc2-b44e-24991657f3c4', 'ce752e5a-a983-4c25-b5f0-34d2f07ea3ae', 'dc4d51c0-2b83-4039-abc0-f0b871106789', 'b862e9a9-36b2-47e8-bf3f-df51671ab7cf'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:43 devstack sudo[109265]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-37db3544-7362-4d62-ab6d-eaa95c640cd0 1073741824" returned: 0 in 0.457s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-37db3544-7362-4d62-ab6d-eaa95c640cd0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:43 devstack sudo[109277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-37db3544-7362-4d62-ab6d-eaa95c640cd0 Aug 09 13:00:43 devstack sudo[109277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:43 devstack sudo[109279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:43 devstack sudo[109279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:43 devstack sudo[109279]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:43 devstack sudo[109277]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "cinder-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.251s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-37db3544-7362-4d62-ab6d-eaa95c640cd0" returned: 0 in 0.289s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:43 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Deleted volume successfully. Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.634s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1720973543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae685fba-61b0-47fb-a30f-f4981a81105a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c3cc18881744d09ba10bac3b3fede8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:35Z,use_quota=True,user_id='11b4e82fcf3d4eb2ab453b36b6b0003f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Creating volume ae685fba-61b0-47fb-a30f-f4981a81105a {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:43 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ae685fba-61b0-47fb-a30f-f4981a81105a 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:43 devstack sudo[109283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ae685fba-61b0-47fb-a30f-f4981a81105a 1073741824 Aug 09 13:00:43 devstack sudo[109283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71a74925-59be-4622-b3ac-725004ad973f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37db3544-7362-4d62-ab6d-eaa95c640cd0', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d306b8-e9a2-4f01-9e78-e506fa9449b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c-delete_volume" acquired by "delete_volume" :: waited 0.102s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-77e1f1f8-9152-44b9-abe8-a007a1c5d246 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-90dbbef7-eefe-4cc0-82b5-00dc5ce097de-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:43 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume volume-37db3544-7362-4d62-ab6d-eaa95c640cd0 (37db3544-7362-4d62-ab6d-eaa95c640cd0): created successfully Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70d306b8-e9a2-4f01-9e78-e506fa9449b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:43 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Flow 'volume_create_manager' (deea44d8-7977-4bd9-9bf7-4cd83b915424) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:43 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4ae54540-1603-4be4-935b-b4b591454dbe tempest-CreateVolumesFromSnapshotTest-1150903419 None] Created volume successfully. Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "cinder-quobyte-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Acquiring lock "cinder-c6fdaac0-486e-4923-bacb-a64c8cbdf419-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-quobyte-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c" acquired by "delete_volume" :: waited 0.033s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Lock "cinder-c6fdaac0-486e-4923-bacb-a64c8cbdf419-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Acquiring lock "cinder-quobyte-0b85f93b-d6ec-4538-a83c-122dcda95d5d" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0789fe68-6e33-434a-9a6f-7470b57aa45d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Lock "cinder-quobyte-0b85f93b-d6ec-4538-a83c-122dcda95d5d" acquired by "delete_snapshot" :: waited 0.038s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Acquiring lock "cinder-quobyte-c6fdaac0-486e-4923-bacb-a64c8cbdf419" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Lock "cinder-quobyte-c6fdaac0-486e-4923-bacb-a64c8cbdf419" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Deleting offline snapshot c6fdaac0-486e-4923-bacb-a64c8cbdf419 of volume 0b85f93b-d6ec-4538-a83c-122dcda95d5d {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] snapshot_file for this snap is: volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f69be5ab-97fc-4ca1-b55b-4d21e997c26c]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:44 devstack sudo[109286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c Aug 09 13:00:44 devstack sudo[109286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:44 devstack sudo[109289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 Aug 09 13:00:44 devstack sudo[109289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:44 devstack sudo[109283]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ae685fba-61b0-47fb-a30f-f4981a81105a 1073741824" returned: 0 in 0.632s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:44 devstack sudo[109286]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c" returned: 0 in 0.446s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ae685fba-61b0-47fb-a30f-f4981a81105a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:44 devstack sudo[109298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c Aug 09 13:00:44 devstack sudo[109298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:44 devstack sudo[109300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ae685fba-61b0-47fb-a30f-f4981a81105a Aug 09 13:00:44 devstack sudo[109300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:44 devstack sudo[109289]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419" returned: 0 in 0.447s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[dadd626d-d7a6-4fa3-ab65-dabb0cacdd83]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:44 devstack sudo[109304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d Aug 09 13:00:44 devstack sudo[109304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:44 devstack sudo[109298]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c" returned: 0 in 0.277s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:44 devstack sudo[109300]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ae685fba-61b0-47fb-a30f-f4981a81105a" returned: 0 in 0.279s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-quobyte-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c" released by "delete_volume" :: held 0.803s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.284s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-372904838',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba501de7-098d-4635-9fd0-24f885f1fca3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c3cc18881744d09ba10bac3b3fede8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:35Z,use_quota=True,user_id='11b4e82fcf3d4eb2ab453b36b6b0003f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Creating volume ba501de7-098d-4635-9fd0-24f885f1fca3 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:44 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba501de7-098d-4635-9fd0-24f885f1fca3 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4554f5e-d1bc-40cc-a2aa-019a2e63db89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae685fba-61b0-47fb-a30f-f4981a81105a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:44 devstack sudo[109308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba501de7-098d-4635-9fd0-24f885f1fca3 1073741824 Aug 09 13:00:44 devstack sudo[109308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e609f5-6181-4fca-b277-d5282c69f7c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:44 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume volume-ae685fba-61b0-47fb-a30f-f4981a81105a (ae685fba-61b0-47fb-a30f-f4981a81105a): created successfully Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30e609f5-6181-4fca-b277-d5282c69f7c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Flow 'volume_create_manager' (eedf42a3-5cd4-4e3e-b86f-26e2968fe42e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:44 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2f198674-c8cd-47e9-9ff5-84897bbb7b9d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Created volume successfully. Aug 09 13:00:44 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Created reservations ['449d34aa-604a-4eca-a5eb-71390ca06c2d', '7584660d-3931-449c-bf24-911c0e729a11', '3581e60c-4b36-4866-9dff-aa7e402352d0', 'eebd1a7e-c6db-41c3-b1aa-98e4efb8d2c1'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:45 devstack sudo[109304]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d" returned: 0 in 0.392s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:45 devstack sudo[109313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 Aug 09 13:00:45 devstack sudo[109313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:45 devstack sudo[109314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:45 devstack sudo[109314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:45 devstack sudo[109308]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba501de7-098d-4635-9fd0-24f885f1fca3 1073741824" returned: 0 in 0.513s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:45 devstack sudo[109314]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.306s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:45 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Deleted volume successfully. Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba501de7-098d-4635-9fd0-24f885f1fca3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-fc168332-fe86-4547-b7f4-7b1de77709a7 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-f727d9d8-f4ec-4c2e-9b96-5e6c25fa8f2c-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:45 devstack sudo[109324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba501de7-098d-4635-9fd0-24f885f1fca3 Aug 09 13:00:45 devstack sudo[109324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:45 devstack sudo[109313]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419" returned: 0 in 0.417s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:45 devstack sudo[109326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419 Aug 09 13:00:45 devstack sudo[109326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:45 devstack sudo[109324]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba501de7-098d-4635-9fd0-24f885f1fca3" returned: 0 in 0.271s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.754s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-459176758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96b4370a-29d3-4a33-9265-c6164a8d4357,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a9c3cc18881744d09ba10bac3b3fede8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:36Z,use_quota=True,user_id='11b4e82fcf3d4eb2ab453b36b6b0003f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Creating volume 96b4370a-29d3-4a33-9265-c6164a8d4357 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:45 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96b4370a-29d3-4a33-9265-c6164a8d4357 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:45 devstack sudo[109326]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d.c6fdaac0-486e-4923-bacb-a64c8cbdf419" returned: 0 in 0.260s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:45 devstack sudo[109330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96b4370a-29d3-4a33-9265-c6164a8d4357 1073741824 Aug 09 13:00:45 devstack sudo[109330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae74aa0a-63fc-48b8-bd40-7934caa75145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba501de7-098d-4635-9fd0-24f885f1fca3', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56546d9-cd59-49fb-87b8-20d9605b7281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:45 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume volume-ba501de7-098d-4635-9fd0-24f885f1fca3 (ba501de7-098d-4635-9fd0-24f885f1fca3): created successfully Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b56546d9-cd59-49fb-87b8-20d9605b7281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Flow 'volume_create_manager' (5d05c742-8717-4c13-b0ab-94a3298a422a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Lock "cinder-quobyte-c6fdaac0-486e-4923-bacb-a64c8cbdf419" released by "_delete_snapshot" :: held 1.669s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Lock "cinder-quobyte-0b85f93b-d6ec-4538-a83c-122dcda95d5d" released by "delete_snapshot" :: held 1.698s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:45 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-86a93fd5-7c4a-4bf6-8dba-d362133831b3 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Created volume successfully. Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Created reservations ['93dbcdd7-a7de-4320-9351-acef828f2ae8', '1a907075-8348-4a8a-be0e-bf4c9ca45bca', '6a6605af-9d7a-4d83-8269-52cf70d89199', '500a6ab5-cf0d-4acb-adb6-b6a5198904c4'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:45 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Delete snapshot completed successfully. Aug 09 13:00:45 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a1cf28a0-ab9c-48b8-889b-3639ec7aad7b tempest-CinderUnicodeTest-402267638 None] Lock "cinder-c6fdaac0-486e-4923-bacb-a64c8cbdf419-delete_snapshot" released by "delete_snapshot" :: held 1.872s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "cinder-acc9a167-0927-4e73-b6b9-d853f3402601-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-acc9a167-0927-4e73-b6b9-d853f3402601-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "cinder-quobyte-acc9a167-0927-4e73-b6b9-d853f3402601" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-quobyte-acc9a167-0927-4e73-b6b9-d853f3402601" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bfb14c9-71e4-419b-809d-3ec4d3e5a9a0]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-acc9a167-0927-4e73-b6b9-d853f3402601 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:46 devstack sudo[109330]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96b4370a-29d3-4a33-9265-c6164a8d4357 1073741824" returned: 0 in 0.500s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Acquiring lock "cinder-0b85f93b-d6ec-4538-a83c-122dcda95d5d-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Lock "cinder-0b85f93b-d6ec-4538-a83c-122dcda95d5d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96b4370a-29d3-4a33-9265-c6164a8d4357 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:46 devstack sudo[109337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96b4370a-29d3-4a33-9265-c6164a8d4357 Aug 09 13:00:46 devstack sudo[109337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Acquiring lock "cinder-quobyte-0b85f93b-d6ec-4538-a83c-122dcda95d5d" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:46 devstack sudo[109336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-acc9a167-0927-4e73-b6b9-d853f3402601 Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Lock "cinder-quobyte-0b85f93b-d6ec-4538-a83c-122dcda95d5d" acquired by "delete_volume" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:46 devstack sudo[109336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c74c17-5492-4bee-8691-3fedac9df872]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:46 devstack sudo[109340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d Aug 09 13:00:46 devstack sudo[109340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:46 devstack sudo[109337]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96b4370a-29d3-4a33-9265-c6164a8d4357" returned: 0 in 0.294s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.810s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-464411358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a524c6de-bf85-4db0-a320-f559361e1306,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f33e25b5e8a490fb86c172de4f7657b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:41Z,use_quota=True,user_id='dedbff7bb09a47de8ad4758bdcc8e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Creating volume a524c6de-bf85-4db0-a320-f559361e1306 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:46 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:46 devstack sudo[109336]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfec40d5-27b9-4707-b474-bf327bc20b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96b4370a-29d3-4a33-9265-c6164a8d4357', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b969ccf-462b-419d-a857-57448ace2f4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-acc9a167-0927-4e73-b6b9-d853f3402601" returned: 0 in 0.467s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-acc9a167-0927-4e73-b6b9-d853f3402601 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:46 devstack sudo[109346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306 1073741824 Aug 09 13:00:46 devstack sudo[109346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:46 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Volume volume-96b4370a-29d3-4a33-9265-c6164a8d4357 (96b4370a-29d3-4a33-9265-c6164a8d4357): created successfully Aug 09 13:00:46 devstack sudo[109348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-acc9a167-0927-4e73-b6b9-d853f3402601 Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b969ccf-462b-419d-a857-57448ace2f4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:46 devstack sudo[109348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Flow 'volume_create_manager' (82dba4b2-87dc-451a-9a89-6d00e16b19e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:46 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f9083be7-ed22-4bbe-adcb-9ea05b9ff59f tempest-CreateVolumesFromSnapshotTest-1150903419 None] Created volume successfully. Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-96b4370a-29d3-4a33-9265-c6164a8d4357-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:46 devstack sudo[109340]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d" returned: 0 in 0.479s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-96b4370a-29d3-4a33-9265-c6164a8d4357-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:46 devstack sudo[109353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d Aug 09 13:00:46 devstack sudo[109353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:46 devstack sudo[109348]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-quobyte-96b4370a-29d3-4a33-9265-c6164a8d4357" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-acc9a167-0927-4e73-b6b9-d853f3402601" returned: 0 in 0.291s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:46 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-96b4370a-29d3-4a33-9265-c6164a8d4357" acquired by "delete_volume" :: waited 0.033s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-quobyte-acc9a167-0927-4e73-b6b9-d853f3402601" released by "delete_volume" :: held 0.832s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf2d7a8-e7eb-47b3-abea-b9e4caa2be27]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96b4370a-29d3-4a33-9265-c6164a8d4357 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Created reservations ['1a00232c-33a5-483f-93e5-94c1d7002fe7', '6d53039f-7e20-4cbd-b68e-77cc6239b9c0', 'd9a5eccd-ddfe-44db-951a-20603d2264c9', '68b86508-a375-49e5-966d-67fc8fa1dc4a'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:47 devstack sudo[109359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96b4370a-29d3-4a33-9265-c6164a8d4357 Aug 09 13:00:47 devstack sudo[109359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:47 devstack sudo[109361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:47 devstack sudo[109361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:47 devstack sudo[109353]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-0b85f93b-d6ec-4538-a83c-122dcda95d5d" returned: 0 in 0.365s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:47 devstack sudo[109346]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306 1073741824" returned: 0 in 0.646s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Lock "cinder-quobyte-0b85f93b-d6ec-4538-a83c-122dcda95d5d" released by "delete_volume" :: held 0.921s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "cinder-de23e204-e7c1-4307-91ae-f4b373460a44-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-de23e204-e7c1-4307-91ae-f4b373460a44-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:47 devstack sudo[109365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306 Aug 09 13:00:47 devstack sudo[109365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Created reservations ['74384af9-2ede-40c4-9263-139e0632f236', '876de5fa-7566-4ae3-8cd2-c2dec06a4462', '45145bdc-2a85-42b4-a346-d396f286b295', 'e4246ce3-07d0-4c6d-9839-16ec65af465d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "cinder-quobyte-de23e204-e7c1-4307-91ae-f4b373460a44" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-quobyte-de23e204-e7c1-4307-91ae-f4b373460a44" acquired by "delete_volume" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ec30001-d17f-4d74-b8f1-621cde071613]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de23e204-e7c1-4307-91ae-f4b373460a44 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:47 devstack sudo[109359]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96b4370a-29d3-4a33-9265-c6164a8d4357" returned: 0 in 0.552s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96b4370a-29d3-4a33-9265-c6164a8d4357 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:47 devstack sudo[109361]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.443s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:47 devstack sudo[109372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96b4370a-29d3-4a33-9265-c6164a8d4357 Aug 09 13:00:47 devstack sudo[109372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:47 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Deleted volume successfully. Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:47 devstack sudo[109370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de23e204-e7c1-4307-91ae-f4b373460a44 Aug 09 13:00:47 devstack sudo[109370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-81cd7f92-db25-4faf-9842-6b39b50d0f80 tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-acc9a167-0927-4e73-b6b9-d853f3402601-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:47 devstack sudo[109365]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306" returned: 0 in 0.376s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:47 devstack sudo[109376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:47 devstack sudo[109376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f947e62-bb25-4440-93ac-fbfefe5f2ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a524c6de-bf85-4db0-a320-f559361e1306', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b753952a-881c-4183-964d-1486c5ecc326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:47 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Volume volume-a524c6de-bf85-4db0-a320-f559361e1306 (a524c6de-bf85-4db0-a320-f559361e1306): created successfully Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b753952a-881c-4183-964d-1486c5ecc326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Flow 'volume_create_manager' (0ebef43d-5b7d-431d-94f1-7246ac7866a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:47 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-37e998da-d26c-4ef2-b30a-c526a7b8b3f2 tempest-ProjectReaderTests-201724270 None] Created volume successfully. Aug 09 13:00:47 devstack sudo[109372]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-96b4370a-29d3-4a33-9265-c6164a8d4357" returned: 0 in 0.331s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-96b4370a-29d3-4a33-9265-c6164a8d4357" released by "delete_volume" :: held 0.937s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:47 devstack sudo[109376]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.318s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:47 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Deleted volume successfully. Aug 09 13:00:47 devstack sudo[109370]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de23e204-e7c1-4307-91ae-f4b373460a44" returned: 0 in 0.485s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:47 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de23e204-e7c1-4307-91ae-f4b373460a44 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:48 devstack sudo[109417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de23e204-e7c1-4307-91ae-f4b373460a44 Aug 09 13:00:48 devstack sudo[109417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-e07b3928-d197-43c7-869e-b0dcc4f99bbc tempest-CinderUnicodeTest-402267638 None] Lock "cinder-0b85f93b-d6ec-4538-a83c-122dcda95d5d-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Created reservations ['1b7a21f3-e530-43c6-96e1-0b0853478e42', 'ab2383e2-2442-4b2b-a9b2-4b78661b3785', 'cb5df0ba-5c8b-4a8d-817b-4f7a67cd1d43', '9e0648d3-754c-44bd-ade1-c9e41376a12f'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:48 devstack sudo[109421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:48 devstack sudo[109421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:48 devstack sudo[109417]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-de23e204-e7c1-4307-91ae-f4b373460a44" returned: 0 in 0.350s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-quobyte-de23e204-e7c1-4307-91ae-f4b373460a44" released by "delete_volume" :: held 0.899s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] Creating offline snapshot 66c432d8-bb2c-4362-8918-1ced0a8011ba of volume a524c6de-bf85-4db0-a320-f559361e1306 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[c43f4f3e-356b-44cd-94a1-71c82da49b0a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:48 devstack sudo[109421]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Created reservations ['3530db45-de40-433d-b7b2-ca1a86c4e768', '4fe5edd8-4f1e-4c22-aa73-68091c1b8b0f', 'b60a4bba-9752-486d-9927-96131e6bbb37', '7cfa0f57-bfc7-41e4-9ed5-dd78ca4baa64'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.351s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Deleted volume successfully. Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-914fa8e4-f882-49f9-9926-573daf4b1515 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-96b4370a-29d3-4a33-9265-c6164a8d4357-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Acquiring lock "cinder-afa6b3da-5d36-40cd-9e53-4587f7c32db2-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Lock "cinder-afa6b3da-5d36-40cd-9e53-4587f7c32db2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:48 devstack sudo[109425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306 Aug 09 13:00:48 devstack sudo[109425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:48 devstack sudo[109426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:48 devstack sudo[109426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Acquiring lock "cinder-quobyte-afa6b3da-5d36-40cd-9e53-4587f7c32db2" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Lock "cinder-quobyte-afa6b3da-5d36-40cd-9e53-4587f7c32db2" acquired by "delete_volume" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7222843d-bc52-420b-8270-c490068e7b3a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:48 devstack sudo[109429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2 Aug 09 13:00:48 devstack sudo[109429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:48 devstack sudo[109426]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.262s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:48 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Deleted volume successfully. Aug 09 13:00:48 devstack sudo[109425]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306" returned: 0 in 0.423s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:48 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-a5f6df6c-0281-4f52-ba03-f1250698c20b tempest-CreateVolumesFromSourceVolumeTest-952873274 None] Lock "cinder-de23e204-e7c1-4307-91ae-f4b373460a44-delete_volume" released by "delete_volume" :: held 1.557s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:48 devstack sudo[109435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba 1G Aug 09 13:00:48 devstack sudo[109435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:49 devstack sudo[109429]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2" returned: 0 in 0.390s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:49 devstack sudo[109441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2 Aug 09 13:00:49 devstack sudo[109441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-ba501de7-098d-4635-9fd0-24f885f1fca3-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-ba501de7-098d-4635-9fd0-24f885f1fca3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-quobyte-ba501de7-098d-4635-9fd0-24f885f1fca3" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-ba501de7-098d-4635-9fd0-24f885f1fca3" acquired by "delete_volume" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3e31ff4-17d0-4633-9f2c-3caf6db1f0ff]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba501de7-098d-4635-9fd0-24f885f1fca3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:49 devstack sudo[109441]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:49 devstack sudo[109435]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-afa6b3da-5d36-40cd-9e53-4587f7c32db2" returned: 0 in 0.285s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:49 devstack sudo[109446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba501de7-098d-4635-9fd0-24f885f1fca3 Aug 09 13:00:49 devstack sudo[109446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba 1G" returned: 0 in 0.480s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a524c6de-bf85-4db0-a320-f559361e1306 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Lock "cinder-quobyte-afa6b3da-5d36-40cd-9e53-4587f7c32db2" released by "delete_volume" :: held 0.734s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:49 devstack sudo[109450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a524c6de-bf85-4db0-a320-f559361e1306 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba Aug 09 13:00:49 devstack sudo[109450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Created reservations ['88baed51-bde3-4d16-bf51-4dbb29eb2b62', '4aacd678-c2e1-4df9-ab96-67b852d776c9', '7e049381-018b-4665-bdd5-6936a9d43a4f', 'e3af98b3-0e46-41ec-b571-ac515ff1f653'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:49 devstack sudo[109452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:49 devstack sudo[109452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:49 devstack sudo[109446]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba501de7-098d-4635-9fd0-24f885f1fca3" returned: 0 in 0.489s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba501de7-098d-4635-9fd0-24f885f1fca3 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:49 devstack sudo[109450]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a524c6de-bf85-4db0-a320-f559361e1306 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba" returned: 0 in 0.369s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:49 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba is being set with open permissions: ugo+rw Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:49 devstack sudo[109460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba501de7-098d-4635-9fd0-24f885f1fca3 Aug 09 13:00:49 devstack sudo[109460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:49 devstack sudo[109461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba Aug 09 13:00:49 devstack sudo[109461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:49 devstack sudo[109452]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.404s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:49 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:49 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Deleted volume successfully. Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4d6e8863-5a52-4234-b66c-ce9105443c62 tempest-CinderUnicodeTest-402267638 None] Lock "cinder-afa6b3da-5d36-40cd-9e53-4587f7c32db2-delete_volume" released by "delete_volume" :: held 1.435s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:50 devstack sudo[109460]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ba501de7-098d-4635-9fd0-24f885f1fca3" returned: 0 in 0.373s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:50 devstack sudo[109461]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba" returned: 0 in 0.358s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-ba501de7-098d-4635-9fd0-24f885f1fca3" released by "delete_volume" :: held 0.908s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:50 devstack sudo[109467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.info Aug 09 13:00:50 devstack sudo[109467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Created reservations ['e483d4a7-a16b-49bf-be2b-5e7a28ff8b29', '2cc14af0-9582-42d9-9e10-d059766e416b', '4308b62b-da09-45f7-b4da-767c64f16607', 'ee65f7f8-546c-4873-8397-366c5e3ebec5'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:50 devstack sudo[109469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:50 devstack sudo[109469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:50 devstack sudo[109467]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.info" returned: 0 in 0.421s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:50 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.info is being set with open permissions: ugo+rw Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:50 devstack sudo[109473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.info Aug 09 13:00:50 devstack sudo[109473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:50 devstack sudo[109469]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.414s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:50 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Deleted volume successfully. Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4097c4dd-d43e-4652-b1f2-29ea75898234 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-ba501de7-098d-4635-9fd0-24f885f1fca3-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:50 devstack sudo[109473]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.info" returned: 0 in 0.299s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.484s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:51 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-a6e82a27-cdda-4cc2-83ea-18f6ea72859f tempest-ProjectReaderTests-201724270 None] Create snapshot completed successfully Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-ae685fba-61b0-47fb-a30f-f4981a81105a-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-ae685fba-61b0-47fb-a30f-f4981a81105a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-quobyte-ae685fba-61b0-47fb-a30f-f4981a81105a" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-ae685fba-61b0-47fb-a30f-f4981a81105a" acquired by "delete_volume" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac7198f-2c0f-440c-a993-e285faaf3a8f]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ae685fba-61b0-47fb-a30f-f4981a81105a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-66c432d8-bb2c-4362-8918-1ced0a8011ba-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Lock "cinder-66c432d8-bb2c-4362-8918-1ced0a8011ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-a524c6de-bf85-4db0-a320-f559361e1306" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-a524c6de-bf85-4db0-a320-f559361e1306" acquired by "delete_snapshot" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-66c432d8-bb2c-4362-8918-1ced0a8011ba" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-66c432d8-bb2c-4362-8918-1ced0a8011ba" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:51 devstack sudo[109478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ae685fba-61b0-47fb-a30f-f4981a81105a Aug 09 13:00:51 devstack sudo[109478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Deleting offline snapshot 66c432d8-bb2c-4362-8918-1ced0a8011ba of volume a524c6de-bf85-4db0-a320-f559361e1306 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] snapshot_file for this snap is: volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed77908-4d97-4550-974c-8f82387308a2]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:51 devstack sudo[109480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba Aug 09 13:00:51 devstack sudo[109480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:52 devstack sudo[109478]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ae685fba-61b0-47fb-a30f-f4981a81105a" returned: 0 in 0.473s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ae685fba-61b0-47fb-a30f-f4981a81105a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:52 devstack sudo[109486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ae685fba-61b0-47fb-a30f-f4981a81105a Aug 09 13:00:52 devstack sudo[109486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:52 devstack sudo[109480]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba" returned: 0 in 0.467s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a524c6de-bf85-4db0-a320-f559361e1306(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3812de6-fbf6-491f-99a3-12dd9bdfb50d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:52 devstack sudo[109486]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ae685fba-61b0-47fb-a30f-f4981a81105a" returned: 0 in 0.290s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-ae685fba-61b0-47fb-a30f-f4981a81105a" released by "delete_volume" :: held 0.820s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Created reservations ['3666ecaa-95f4-4ad9-ae58-52106c7b7990', 'cb9aece4-372d-4726-b1bb-7da3cb8b7df5', '88d4e607-3cb6-4610-8059-b8f703a386ae', 'cee39534-a800-4ca4-8195-0a944d6aad46'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:52 devstack sudo[109493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306 Aug 09 13:00:52 devstack sudo[109493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:52 devstack sudo[109495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:52 devstack sudo[109495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-37db3544-7362-4d62-ab6d-eaa95c640cd0-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-37db3544-7362-4d62-ab6d-eaa95c640cd0-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-quobyte-37db3544-7362-4d62-ab6d-eaa95c640cd0" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:52 devstack sudo[109493]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306" returned: 0 in 0.598s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-37db3544-7362-4d62-ab6d-eaa95c640cd0" acquired by "delete_volume" :: waited 0.039s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:52 devstack sudo[109501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba Aug 09 13:00:52 devstack sudo[109501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e86d0bf-9b09-4cf5-89f8-5026213b2bac]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-37db3544-7362-4d62-ab6d-eaa95c640cd0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:52 devstack sudo[109495]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.372s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:52 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Deleted volume successfully. Aug 09 13:00:52 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-38ba6ca2-b858-450d-85c8-0d9569cbd46d tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-ae685fba-61b0-47fb-a30f-f4981a81105a-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:53 devstack sudo[109503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-37db3544-7362-4d62-ab6d-eaa95c640cd0 Aug 09 13:00:53 devstack sudo[109503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:53 devstack sudo[109501]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba" returned: 0 in 0.465s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:53 devstack sudo[109503]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-37db3544-7362-4d62-ab6d-eaa95c640cd0" returned: 0 in 0.447s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:53 devstack sudo[109511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-37db3544-7362-4d62-ab6d-eaa95c640cd0 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:53 devstack sudo[109511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:53 devstack sudo[109513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-37db3544-7362-4d62-ab6d-eaa95c640cd0 Aug 09 13:00:53 devstack sudo[109513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:53 devstack sudo[109511]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306.66c432d8-bb2c-4362-8918-1ced0a8011ba" returned: 0 in 0.353s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:53 devstack sudo[109513]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-37db3544-7362-4d62-ab6d-eaa95c640cd0" returned: 0 in 0.364s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-66c432d8-bb2c-4362-8918-1ced0a8011ba" released by "_delete_snapshot" :: held 2.029s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-37db3544-7362-4d62-ab6d-eaa95c640cd0" released by "delete_volume" :: held 0.884s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-a524c6de-bf85-4db0-a320-f559361e1306" released by "delete_snapshot" :: held 2.069s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Created reservations ['9807a004-a0dc-4378-ae47-83c8cd2f74f3', '058999c4-340e-4bf4-9e1e-659bfb8a4229', 'e3136926-ba19-4263-ae1d-a55de4b2b12a', '8cc94c0d-f9d0-456d-b203-137456958237'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Created reservations ['1cc1b7b7-3468-4ad1-9f5d-d3b503b29c2f', '83cb1490-5f3e-4a14-8bc0-33376258b7cc', 'f7557e27-f5bb-4b7b-ba1b-c7643310eae7', 'ea6f5ffb-79b9-431e-9f06-069754c7a507'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:54 devstack sudo[109523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:54 devstack sudo[109523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:54 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Delete snapshot completed successfully. Aug 09 13:00:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-591b5a7a-e1b3-4f0c-86d7-c1d8ff99ba50 tempest-ProjectReaderTests-201724270 None] Lock "cinder-66c432d8-bb2c-4362-8918-1ced0a8011ba-delete_snapshot" released by "delete_snapshot" :: held 2.338s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:54 devstack sudo[109523]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.278s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:54 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:54 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Deleted volume successfully. Aug 09 13:00:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-94bc169e-9a29-4d82-a1ff-fd07c20438be tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-37db3544-7362-4d62-ab6d-eaa95c640cd0-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-a524c6de-bf85-4db0-a320-f559361e1306-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Lock "cinder-a524c6de-bf85-4db0-a320-f559361e1306-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-a524c6de-bf85-4db0-a320-f559361e1306" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-a524c6de-bf85-4db0-a320-f559361e1306" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[4563bbdd-83f3-4119-be82-4aae52cff740]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-9b50bbe0-5e10-43b4-b381-578d04f2c46d-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-9b50bbe0-5e10-43b4-b381-578d04f2c46d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-quobyte-9b50bbe0-5e10-43b4-b381-578d04f2c46d" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-9b50bbe0-5e10-43b4-b381-578d04f2c46d" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9fc98c5-b83b-4463-ba5e-0f6bee0f0d64]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:55 devstack sudo[109526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306 Aug 09 13:00:55 devstack sudo[109526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:55 devstack sudo[109527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d Aug 09 13:00:55 devstack sudo[109527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:55 devstack sudo[109526]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306" returned: 0 in 0.547s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:55 devstack sudo[109535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306 Aug 09 13:00:55 devstack sudo[109535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:55 devstack sudo[109527]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d" returned: 0 in 0.470s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:55 devstack sudo[109538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d Aug 09 13:00:55 devstack sudo[109538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:55 devstack sudo[109535]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-a524c6de-bf85-4db0-a320-f559361e1306" returned: 0 in 0.301s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-a524c6de-bf85-4db0-a320-f559361e1306" released by "delete_volume" :: held 0.927s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:55 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Created reservations ['d125ca27-e6c1-4da8-b3c2-c3b06ca6f753', '2dc605bb-f897-413b-a33b-85ba8346703e', 'b0633d14-5855-4081-b543-852eb1331598', '01600e64-032a-48b7-96cb-06d0de15e3df'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:56 devstack sudo[109538]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b50bbe0-5e10-43b4-b381-578d04f2c46d" returned: 0 in 0.334s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-9b50bbe0-5e10-43b4-b381-578d04f2c46d" released by "delete_volume" :: held 0.878s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:56 devstack sudo[109542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:56 devstack sudo[109542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Created reservations ['3930d313-b270-47f1-be52-7653e5b71b86', '93054ded-2a2b-4a1f-a353-cbf1ee25ab6e', 'a071a0d6-c67a-473b-9092-d164079b4840', '37f0f74d-10a9-480a-8447-ca9d5fe988f5'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:56 devstack sudo[109544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:56 devstack sudo[109544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-db666070-e6bd-42f8-9405-3b36f044fa1e-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-db666070-e6bd-42f8-9405-3b36f044fa1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-quobyte-139eb3ba-8932-4f2f-bd4c-fc400b5c584a" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-139eb3ba-8932-4f2f-bd4c-fc400b5c584a" acquired by "delete_snapshot" :: waited 0.037s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-quobyte-db666070-e6bd-42f8-9405-3b36f044fa1e" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-db666070-e6bd-42f8-9405-3b36f044fa1e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Deleting offline snapshot db666070-e6bd-42f8-9405-3b36f044fa1e of volume 139eb3ba-8932-4f2f-bd4c-fc400b5c584a {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:00:56 devstack sudo[109542]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] snapshot_file for this snap is: volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.421s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:56 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Deleted volume successfully. Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[02abefad-3a22-4baf-96fe-162e2912925d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:56 devstack sudo[109544]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.341s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cacb0480-7301-45c3-9680-7105fea8d7c5 tempest-ProjectReaderTests-201724270 None] Lock "cinder-a524c6de-bf85-4db0-a320-f559361e1306-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:56 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Deleted volume successfully. Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-12e4c567-97fe-4f89-aabc-94dd869f796b tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-9b50bbe0-5e10-43b4-b381-578d04f2c46d-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:56 devstack sudo[109555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e Aug 09 13:00:56 devstack sudo[109555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:56 devstack sudo[109555]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e" returned: 0 in 0.415s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1663a123-1f08-4841-8d3d-1a97523b750c]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:57 devstack sudo[109560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a Aug 09 13:00:57 devstack sudo[109560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:57 devstack sudo[109560]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a" returned: 0 in 0.511s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:57 devstack sudo[109566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e Aug 09 13:00:57 devstack sudo[109566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:00:57 devstack sudo[109570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:57 devstack sudo[109570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Flow 'volume_create_manager' (1e52e7ef-5df5-4d7d-aa09-a60019755eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8789a309-b877-49ca-bdda-d94ecadab5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8789a309-b877-49ca-bdda-d94ecadab5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403695055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3824ff-3a55-4b74-ab4d-3895b120373c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f33e25b5e8a490fb86c172de4f7657b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:58Z,use_quota=True,user_id='dedbff7bb09a47de8ad4758bdcc8e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00389a1-d998-4aef-822a-1114b5392fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d00389a1-d998-4aef-822a-1114b5392fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df7ecae-5549-401d-9352-1c6d464bf0bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6df7ecae-5549-401d-9352-1c6d464bf0bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee3824ff-3a55-4b74-ab4d-3895b120373c', 'volume_name': 'volume-ee3824ff-3a55-4b74-ab4d-3895b120373c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0879f4b-7020-45e7-9ee7-8d6c03537ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0879f4b-7020-45e7-9ee7-8d6c03537ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae628f4e-2432-4ff4-abab-8372161f41bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:57 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Volume ee3824ff-3a55-4b74-ab4d-3895b120373c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee3824ff-3a55-4b74-ab4d-3895b120373c', 'volume_size': 1} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-403695055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee3824ff-3a55-4b74-ab4d-3895b120373c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f33e25b5e8a490fb86c172de4f7657b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:00:58Z,use_quota=True,user_id='dedbff7bb09a47de8ad4758bdcc8e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Creating volume ee3824ff-3a55-4b74-ab4d-3895b120373c {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:00:58 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e" returned: 0 in 0.522s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:58 devstack sudo[109566]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:58 devstack sudo[109573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c 1073741824 Aug 09 13:00:58 devstack sudo[109573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:58 devstack sudo[109575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e Aug 09 13:00:58 devstack sudo[109575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:58 devstack sudo[109570]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.334s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 13:00:58 devstack sudo[109575]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a.db666070-e6bd-42f8-9405-3b36f044fa1e" returned: 0 in 0.281s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-db666070-e6bd-42f8-9405-3b36f044fa1e" released by "_delete_snapshot" :: held 1.888s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-139eb3ba-8932-4f2f-bd4c-fc400b5c584a" released by "delete_snapshot" :: held 1.925s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Created reservations ['2de9dbfd-c54e-4f24-8e48-316d20e3942f', 'ea3c369c-2cc5-462d-8ab8-1cfa21b3532e', 'a6450cf2-4636-4ebb-98b5-34d18a13a1e3', '57fd3dcf-8b27-4637-b9e3-9d9f39206252'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:58 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Delete snapshot completed successfully. Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf20a77a-061e-4f91-ab74-ffcd115e3652 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-db666070-e6bd-42f8-9405-3b36f044fa1e-delete_snapshot" released by "delete_snapshot" :: held 2.129s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:58 devstack sudo[109573]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c 1073741824" returned: 0 in 0.551s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:58 devstack sudo[109583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c Aug 09 13:00:58 devstack sudo[109583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-139eb3ba-8932-4f2f-bd4c-fc400b5c584a-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-139eb3ba-8932-4f2f-bd4c-fc400b5c584a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "cinder-quobyte-139eb3ba-8932-4f2f-bd4c-fc400b5c584a" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-139eb3ba-8932-4f2f-bd4c-fc400b5c584a" acquired by "delete_volume" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2ea16f-4604-4f6c-bce8-207f5250a61f]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:58 devstack sudo[109583]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c" returned: 0 in 0.305s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae628f4e-2432-4ff4-abab-8372161f41bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee3824ff-3a55-4b74-ab4d-3895b120373c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e227d9-03ff-44b4-80b7-92dae92bcd2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:00:58 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Volume volume-ee3824ff-3a55-4b74-ab4d-3895b120373c (ee3824ff-3a55-4b74-ab4d-3895b120373c): created successfully Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e227d9-03ff-44b4-80b7-92dae92bcd2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:00:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Flow 'volume_create_manager' (1e52e7ef-5df5-4d7d-aa09-a60019755eb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:00:58 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-aefc368a-8322-4108-b002-ac2ae21781a5 tempest-ProjectReaderTests-201724270 None] Created volume successfully. Aug 09 13:00:59 devstack sudo[109586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a Aug 09 13:00:59 devstack sudo[109586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:59 devstack sudo[109586]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a" returned: 0 in 0.433s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:59 devstack sudo[109591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a Aug 09 13:00:59 devstack sudo[109591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:00:59 devstack sudo[109591]: pam_unix(sudo:session): session closed for user root Aug 09 13:00:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-139eb3ba-8932-4f2f-bd4c-fc400b5c584a" returned: 0 in 0.294s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:00:59 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-quobyte-139eb3ba-8932-4f2f-bd4c-fc400b5c584a" released by "delete_volume" :: held 0.800s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:00:59 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Created reservations ['885ba03d-6314-471a-9aa3-2b69ba712ccd', 'fb700fe3-fa05-4ae6-836e-94ecd3af4274', '37e3d1cf-1539-447c-af7c-6b19507e77a5', 'ceb8c8e0-7bda-4df1-9324-3f976124715f'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:00:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:00:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:00:59 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:00:59 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:00:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:00:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:00:59 devstack sudo[109594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:00:59 devstack sudo[109594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:00 devstack sudo[109594]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.350s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:00 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:00 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Deleted volume successfully. Aug 09 13:01:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] Creating offline snapshot 50f232aa-ac42-4572-b3ad-d734cc1fa315 of volume ee3824ff-3a55-4b74-ab4d-3895b120373c {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:01:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-c4b12903-2b06-4799-bf8d-3b2447606132 tempest-CreateVolumesFromSnapshotTest-1150903419 None] Lock "cinder-139eb3ba-8932-4f2f-bd4c-fc400b5c584a-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:00 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9b6220-d718-4713-9748-17d88eaec712]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:00 devstack sudo[109597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c Aug 09 13:01:00 devstack sudo[109597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:00 devstack sudo[109597]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c" returned: 0 in 0.444s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:00 devstack sudo[109603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 1G Aug 09 13:01:00 devstack sudo[109603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:01 devstack sudo[109603]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 1G" returned: 0 in 0.579s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3824ff-3a55-4b74-ab4d-3895b120373c -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:01 devstack sudo[109609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3824ff-3a55-4b74-ab4d-3895b120373c -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 Aug 09 13:01:01 devstack sudo[109609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:01 devstack sudo[109609]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ee3824ff-3a55-4b74-ab4d-3895b120373c -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315" returned: 0 in 0.416s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:01 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 is being set with open permissions: ugo+rw Aug 09 13:01:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:01 devstack sudo[109614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 Aug 09 13:01:01 devstack sudo[109614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:01 devstack sudo[109614]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315" returned: 0 in 0.304s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:02 devstack sudo[109617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.info Aug 09 13:01:02 devstack sudo[109617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:02 devstack sudo[109617]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.info" returned: 0 in 0.348s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:02 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.info is being set with open permissions: ugo+rw Aug 09 13:01:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:02 devstack sudo[109620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.info Aug 09 13:01:02 devstack sudo[109620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:02 devstack sudo[109620]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.info" returned: 0 in 0.287s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.488s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:02 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-0c31f706-c72d-4f25-8c63-ec2336058337 tempest-ProjectReaderTests-201724270 None] Create snapshot completed successfully Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-50f232aa-ac42-4572-b3ad-d734cc1fa315-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Lock "cinder-50f232aa-ac42-4572-b3ad-d734cc1fa315-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-ee3824ff-3a55-4b74-ab4d-3895b120373c" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-ee3824ff-3a55-4b74-ab4d-3895b120373c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-50f232aa-ac42-4572-b3ad-d734cc1fa315" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-50f232aa-ac42-4572-b3ad-d734cc1fa315" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Deleting offline snapshot 50f232aa-ac42-4572-b3ad-d734cc1fa315 of volume ee3824ff-3a55-4b74-ab4d-3895b120373c {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] snapshot_file for this snap is: volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1569bb2d-a326-44bb-a7c9-b2a9ff96cac3]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=313,cinder:SELECT=238,cinder:INSERT=82,cinder:DELETE=22 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=209,cinder:UPDATE=301,cinder:DELETE=33,cinder:INSERT=84 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Flow 'volume_create_manager' (9669cbb1-5813-4746-b526-3d6f0b86c516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a3d5e0-515f-4882-b46f-374b65459b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31a3d5e0-515f-4882-b46f-374b65459b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-726592796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ef1b5a-aec0-4311-81a5-a4db611fa279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf5dae6efc74d3fa0bb2745981ca3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:04Z,use_quota=True,user_id='fd9f01474adf4be7bdbc4137cea6a976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b06185a-5756-4138-9f2f-2ddb81567684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b06185a-5756-4138-9f2f-2ddb81567684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48370b8-837e-4fb8-8c13-fc5b85425c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d48370b8-837e-4fb8-8c13-fc5b85425c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08ef1b5a-aec0-4311-81a5-a4db611fa279', 'volume_name': 'volume-08ef1b5a-aec0-4311-81a5-a4db611fa279', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b4dfb0-7f62-48fb-bbd5-83ae70b51164) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:03 devstack sudo[109623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 Aug 09 13:01:03 devstack sudo[109623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02b4dfb0-7f62-48fb-bbd5-83ae70b51164) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb5385e-58fb-4de0-9034-8a45f8f55326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:03 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Volume 08ef1b5a-aec0-4311-81a5-a4db611fa279: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08ef1b5a-aec0-4311-81a5-a4db611fa279', 'volume_size': 1} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-726592796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08ef1b5a-aec0-4311-81a5-a4db611fa279,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf5dae6efc74d3fa0bb2745981ca3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:04Z,use_quota=True,user_id='fd9f01474adf4be7bdbc4137cea6a976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Creating volume 08ef1b5a-aec0-4311-81a5-a4db611fa279 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:01:03 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:01:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:03 devstack sudo[109625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 1073741824 Aug 09 13:01:03 devstack sudo[109625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:04 devstack sudo[109623]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315" returned: 0 in 0.496s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ee3824ff-3a55-4b74-ab4d-3895b120373c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:01:04 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b243a21c-54cb-4a12-8e0c-5a6ba3538dce]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:04 devstack sudo[109633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c Aug 09 13:01:04 devstack sudo[109633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:04 devstack sudo[109625]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 1073741824" returned: 0 in 0.613s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:04 devstack sudo[109636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 Aug 09 13:01:04 devstack sudo[109636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:04 devstack sudo[109633]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c" returned: 0 in 0.515s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:04 devstack sudo[109641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 Aug 09 13:01:04 devstack sudo[109641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:04 devstack sudo[109636]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279" returned: 0 in 0.406s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:01:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb5385e-58fb-4de0-9034-8a45f8f55326) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08ef1b5a-aec0-4311-81a5-a4db611fa279', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a279d8f-eb80-4b5d-8bb4-ed159b73f6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:05 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Volume volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 (08ef1b5a-aec0-4311-81a5-a4db611fa279): created successfully Aug 09 13:01:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a279d8f-eb80-4b5d-8bb4-ed159b73f6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Flow 'volume_create_manager' (9669cbb1-5813-4746-b526-3d6f0b86c516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f7bc42dd-b85d-4669-812a-4877bfb28880 tempest-VolumeDependencyTests-1134504077 None] Created volume successfully. Aug 09 13:01:05 devstack sudo[109641]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315" returned: 0 in 0.418s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:05 devstack sudo[109647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315 Aug 09 13:01:05 devstack sudo[109647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:05 devstack sudo[109647]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c.50f232aa-ac42-4572-b3ad-d734cc1fa315" returned: 0 in 0.268s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-50f232aa-ac42-4572-b3ad-d734cc1fa315" released by "_delete_snapshot" :: held 1.814s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-ee3824ff-3a55-4b74-ab4d-3895b120373c" released by "delete_snapshot" :: held 1.846s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:05 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Created reservations ['61be745a-18a7-4ae5-90e6-d49acea26df3', 'f8f7c75c-bc72-4341-af5a-e9b251728038', '45fc6b06-1356-4824-963f-0405a81846ba', '602d7c0b-8612-4f8e-8727-d5883eae048f'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Delete snapshot completed successfully. Aug 09 13:01:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f982823a-2106-470c-8ab0-672d41ce46fc tempest-ProjectReaderTests-201724270 None] Lock "cinder-50f232aa-ac42-4572-b3ad-d734cc1fa315-delete_snapshot" released by "delete_snapshot" :: held 2.011s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-ee3824ff-3a55-4b74-ab4d-3895b120373c-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Lock "cinder-ee3824ff-3a55-4b74-ab4d-3895b120373c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-ee3824ff-3a55-4b74-ab4d-3895b120373c" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:05 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-ee3824ff-3a55-4b74-ab4d-3895b120373c" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:06 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[375c8f98-4394-4180-8a9b-6dc96e0c342b]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:06 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] Creating offline snapshot 068f94b6-4783-4c34-96cc-fefd98d847bc of volume 08ef1b5a-aec0-4311-81a5-a4db611fa279 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:01:06 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c79af78-2d69-4a58-a977-97a8cd3613ca]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:06 devstack sudo[109650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c Aug 09 13:01:06 devstack sudo[109650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:06 devstack sudo[109651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 Aug 09 13:01:06 devstack sudo[109651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:06 devstack sudo[109650]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c" returned: 0 in 0.564s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:06 devstack sudo[109659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c Aug 09 13:01:06 devstack sudo[109659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:06 devstack sudo[109651]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279" returned: 0 in 0.469s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:06 devstack sudo[109662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc 1G Aug 09 13:01:06 devstack sudo[109662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:06 devstack sudo[109659]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-ee3824ff-3a55-4b74-ab4d-3895b120373c" returned: 0 in 0.296s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:06 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-ee3824ff-3a55-4b74-ab4d-3895b120373c" released by "delete_volume" :: held 0.953s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Created reservations ['aa56de89-8940-46e5-83e9-11f75197cbcf', 'f99c86d4-b983-408f-bc8d-11b6fddc7831', '85c4234d-353e-4058-8183-d50e9646ed0d', '1497a9f9-947f-4e8b-96eb-56e4e0277419'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:07 devstack sudo[109668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:07 devstack sudo[109668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:07 devstack sudo[109662]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc 1G" returned: 0 in 0.588s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:07 devstack sudo[109670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc Aug 09 13:01:07 devstack sudo[109670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:07 devstack sudo[109668]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.292s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:07 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Deleted volume successfully. Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-582c0348-5be7-4a80-b618-49dce58ff4a0 tempest-ProjectReaderTests-201724270 None] Lock "cinder-ee3824ff-3a55-4b74-ab4d-3895b120373c-delete_volume" released by "delete_volume" :: held 1.630s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:07 devstack sudo[109670]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc" returned: 0 in 0.391s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:07 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc is being set with open permissions: ugo+rw Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:07 devstack sudo[109676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc Aug 09 13:01:07 devstack sudo[109676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:07 devstack sudo[109676]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc" returned: 0 in 0.269s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:08 devstack sudo[109679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.info Aug 09 13:01:08 devstack sudo[109679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:08 devstack sudo[109679]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.info" returned: 0 in 0.364s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:08 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.info is being set with open permissions: ugo+rw Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:08 devstack sudo[109682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.info Aug 09 13:01:08 devstack sudo[109682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:08 devstack sudo[109682]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.info" returned: 0 in 0.345s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.531s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:08 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f6de49fb-e2b1-4836-8c69-0c2db4926ddd tempest-VolumeDependencyTests-1134504077 None] Create snapshot completed successfully Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Flow 'volume_create_manager' (601e2d6a-7204-4675-9144-0b8fff93d1c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df6c49f-a104-4eab-b82d-c43892afaa7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2df6c49f-a104-4eab-b82d-c43892afaa7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-72099907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73a2afa-3564-46aa-8da5-456dc19f9c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f33e25b5e8a490fb86c172de4f7657b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:09Z,use_quota=True,user_id='dedbff7bb09a47de8ad4758bdcc8e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536283cf-652a-4858-8c64-2e2e002e2ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (536283cf-652a-4858-8c64-2e2e002e2ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838cd495-c2e4-4b3d-a333-f2bbb0ad887b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (838cd495-c2e4-4b3d-a333-f2bbb0ad887b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e73a2afa-3564-46aa-8da5-456dc19f9c03', 'volume_name': 'volume-e73a2afa-3564-46aa-8da5-456dc19f9c03', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3fdc31-cf6b-44f9-97dc-894e96a51cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c3fdc31-cf6b-44f9-97dc-894e96a51cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8447b412-4ba5-4491-9f64-11920d444fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:08 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Volume e73a2afa-3564-46aa-8da5-456dc19f9c03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e73a2afa-3564-46aa-8da5-456dc19f9c03', 'volume_size': 1} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-72099907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e73a2afa-3564-46aa-8da5-456dc19f9c03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f33e25b5e8a490fb86c172de4f7657b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:09Z,use_quota=True,user_id='dedbff7bb09a47de8ad4758bdcc8e6ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Creating volume e73a2afa-3564-46aa-8da5-456dc19f9c03 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:01:08 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:01:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:08 devstack sudo[109685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 1073741824 Aug 09 13:01:08 devstack sudo[109685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:09 devstack sudo[109685]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 1073741824" returned: 0 in 0.526s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:09 devstack sudo[109691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 Aug 09 13:01:09 devstack sudo[109691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:09 devstack sudo[109691]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03" returned: 0 in 0.371s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:09 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:01:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8447b412-4ba5-4491-9f64-11920d444fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e73a2afa-3564-46aa-8da5-456dc19f9c03', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5adab019-b6b8-4295-8959-52994044a331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:09 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Volume volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 (e73a2afa-3564-46aa-8da5-456dc19f9c03): created successfully Aug 09 13:01:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5adab019-b6b8-4295-8959-52994044a331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:09 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Flow 'volume_create_manager' (601e2d6a-7204-4675-9144-0b8fff93d1c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:10 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-32fc91ca-740b-472d-ae42-168dfe2b8bd5 tempest-ProjectReaderTests-201724270 None] Created volume successfully. Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Flow 'volume_create_manager' (05a96bbd-1df0-4ccd-bca9-c4c414210d7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9055c6-86fe-446c-b65d-b65d6c3ae740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe9055c6-86fe-446c-b65d-b65d6c3ae740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-342438773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f741204d-f88f-4038-ad56-e80ee7b70c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cf5dae6efc74d3fa0bb2745981ca3e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=068f94b6-4783-4c34-96cc-fefd98d847bc,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:10Z,use_quota=True,user_id='fd9f01474adf4be7bdbc4137cea6a976',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2767cf9-a2e6-4615-8576-a4f8c568aa37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2767cf9-a2e6-4615-8576-a4f8c568aa37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962c229b-4c1c-4d16-a78a-9676895dea94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (962c229b-4c1c-4d16-a78a-9676895dea94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f741204d-f88f-4038-ad56-e80ee7b70c94', 'volume_name': 'volume-f741204d-f88f-4038-ad56-e80ee7b70c94', 'volume_size': 1, 'snapshot_id': '068f94b6-4783-4c34-96cc-fefd98d847bc'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef41e35-328c-47f8-a5dc-05c7b23c24a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ef41e35-328c-47f8-a5dc-05c7b23c24a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb26f97d-fbba-453c-8fd5-21b7935aae62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:10 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Volume f741204d-f88f-4038-ad56-e80ee7b70c94: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f741204d-f88f-4038-ad56-e80ee7b70c94', 'volume_size': 1, 'snapshot_id': '068f94b6-4783-4c34-96cc-fefd98d847bc'} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "cinder-quobyte-068f94b6-4783-4c34-96cc-fefd98d847bc-f741204d-f88f-4038-ad56-e80ee7b70c94" by "_create_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-quobyte-068f94b6-4783-4c34-96cc-fefd98d847bc-f741204d-f88f-4038-ad56-e80ee7b70c94" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Creating volume f741204d-f88f-4038-ad56-e80ee7b70c94 from snapshot 068f94b6-4783-4c34-96cc-fefd98d847bc {{(pid=89309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "cinder-quobyte-f741204d-f88f-4038-ad56-e80ee7b70c94" by "_copy_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-quobyte-f741204d-f88f-4038-ad56-e80ee7b70c94" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] snapshot: 068f94b6-4783-4c34-96cc-fefd98d847bc, volume: f741204d-f88f-4038-ad56-e80ee7b70c94, {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fac50f8c-d85f-490b-8135-dc225944a212]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:10 devstack sudo[109694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc Aug 09 13:01:10 devstack sudo[109694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:10 devstack sudo[109694]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc" returned: 0 in 0.395s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08ef1b5a-aec0-4311-81a5-a4db611fa279(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2358a7bc-07cf-41b1-8cf5-4caad78411ab]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:10 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:10 devstack sudo[109700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 Aug 09 13:01:10 devstack sudo[109700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:11 devstack sudo[109700]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279" returned: 0 in 0.439s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Creating direct copy from snapshot {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.utils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Path /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94 not found in is_blk_device check {{(pid=89309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:11 devstack sudo[109705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94 Aug 09 13:01:11 devstack sudo[109705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Flow 'volume_create_manager' (9b9d073e-70ae-4b43-9df9-7defec28f655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae7d129-1ed2-4667-98d9-89942b024441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ae7d129-1ed2-4667-98d9-89942b024441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2117091458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69db7435-7a97-42b1-8139-99497245beba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6229b7ce0b914c8297617befb1085bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:11Z,use_quota=True,user_id='0de5568a36db4c2da27c57fed83da7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed6ba05-0b5b-4cfb-a5c9-c048a6c53777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed6ba05-0b5b-4cfb-a5c9-c048a6c53777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (176a7536-fe7e-447e-a3af-63e5fb062ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (176a7536-fe7e-447e-a3af-63e5fb062ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69db7435-7a97-42b1-8139-99497245beba', 'volume_name': 'volume-69db7435-7a97-42b1-8139-99497245beba', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e93c7b-ebce-44f6-b59e-717a8993617d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e93c7b-ebce-44f6-b59e-717a8993617d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31717ec6-5d93-4df8-85fa-0d8c2a9ae56e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:11 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Volume 69db7435-7a97-42b1-8139-99497245beba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69db7435-7a97-42b1-8139-99497245beba', 'volume_size': 1} Aug 09 13:01:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:16 devstack sudo[109705]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94" returned: 0 in 4.910s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279, size 1024.00 MB, duration 4.91 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 13:01:16 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Converted 1024.00 MB image at 208.53 MB/s Aug 09 13:01:16 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94 is being set with open permissions: ugo+rw Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:16 devstack sudo[109721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94 Aug 09 13:01:16 devstack sudo[109721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:16 devstack sudo[109721]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94" returned: 0 in 0.246s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-quobyte-f741204d-f88f-4038-ad56-e80ee7b70c94" released by "_copy_volume_from_snapshot" :: held 6.080s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-quobyte-068f94b6-4783-4c34-96cc-fefd98d847bc-f741204d-f88f-4038-ad56-e80ee7b70c94" released by "_create_volume_from_snapshot" :: held 6.155s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.175s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.902s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] Creating offline snapshot 67280eb0-d730-430a-ac8d-fb178a507a1e of volume e73a2afa-3564-46aa-8da5-456dc19f9c03 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb26f97d-fbba-453c-8fd5-21b7935aae62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f741204d-f88f-4038-ad56-e80ee7b70c94', 'volume_size': 1, 'snapshot_id': '068f94b6-4783-4c34-96cc-fefd98d847bc'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093a55d2-9421-403b-8176-b00034134a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7792ce9-61c2-4406-bdee-88db1aba0b18]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:16 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Volume volume-f741204d-f88f-4038-ad56-e80ee7b70c94 (f741204d-f88f-4038-ad56-e80ee7b70c94): created successfully Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (093a55d2-9421-403b-8176-b00034134a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Flow 'volume_create_manager' (05a96bbd-1df0-4ccd-bca9-c4c414210d7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:16 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5e13b3ca-9254-4358-9eb3-f87c2991a595 tempest-VolumeDependencyTests-1134504077 None] Created volume successfully. Aug 09 13:01:16 devstack sudo[109724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 Aug 09 13:01:16 devstack sudo[109724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:16 devstack sudo[109724]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03" returned: 0 in 0.365s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:16 devstack sudo[109729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e 1G Aug 09 13:01:16 devstack sudo[109729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "cinder-068f94b6-4783-4c34-96cc-fefd98d847bc-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-068f94b6-4783-4c34-96cc-fefd98d847bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "cinder-quobyte-08ef1b5a-aec0-4311-81a5-a4db611fa279" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-quobyte-08ef1b5a-aec0-4311-81a5-a4db611fa279" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "cinder-quobyte-068f94b6-4783-4c34-96cc-fefd98d847bc" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-quobyte-068f94b6-4783-4c34-96cc-fefd98d847bc" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Deleting offline snapshot 068f94b6-4783-4c34-96cc-fefd98d847bc of volume 08ef1b5a-aec0-4311-81a5-a4db611fa279 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] snapshot_file for this snap is: volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d3affe-91b3-4573-b811-67bf054d8b04]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:17 devstack sudo[109731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc Aug 09 13:01:17 devstack sudo[109731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:17 devstack sudo[109729]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e 1G" returned: 0 in 0.417s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:17 devstack sudo[109738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e Aug 09 13:01:17 devstack sudo[109738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:17 devstack sudo[109731]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc" returned: 0 in 0.372s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:17 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08ef1b5a-aec0-4311-81a5-a4db611fa279(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:01:17 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[92d201d9-a909-426b-ae9e-c18f152e4d8b]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:17 devstack sudo[109742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 Aug 09 13:01:17 devstack sudo[109742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:17 devstack sudo[109738]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e" returned: 0 in 0.293s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:17 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e is being set with open permissions: ugo+rw Aug 09 13:01:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:17 devstack sudo[109747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e Aug 09 13:01:17 devstack sudo[109747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:17 devstack sudo[109747]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e" returned: 0 in 0.269s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:17 devstack sudo[109752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.info Aug 09 13:01:17 devstack sudo[109752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:17 devstack sudo[109742]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279" returned: 0 in 0.555s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:17 devstack sudo[109756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc Aug 09 13:01:17 devstack sudo[109756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:18 devstack sudo[109752]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.info" returned: 0 in 0.262s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:18 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.info is being set with open permissions: ugo+rw Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:18 devstack sudo[109760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.info Aug 09 13:01:18 devstack sudo[109760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:18 devstack sudo[109756]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc" returned: 0 in 0.357s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:18 devstack sudo[109769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc Aug 09 13:01:18 devstack sudo[109769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:18 devstack sudo[109760]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.info" returned: 0 in 0.255s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.956s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.737s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2117091458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69db7435-7a97-42b1-8139-99497245beba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6229b7ce0b914c8297617befb1085bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:11Z,use_quota=True,user_id='0de5568a36db4c2da27c57fed83da7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Creating volume 69db7435-7a97-42b1-8139-99497245beba {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:01:18 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-69db7435-7a97-42b1-8139-99497245beba 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:18 devstack sudo[109772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-69db7435-7a97-42b1-8139-99497245beba 1073741824 Aug 09 13:01:18 devstack sudo[109772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:18 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-6332fe41-071e-4b33-8756-bb2d486b06bf tempest-ProjectReaderTests-201724270 None] Create snapshot completed successfully Aug 09 13:01:18 devstack sudo[109769]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279.068f94b6-4783-4c34-96cc-fefd98d847bc" returned: 0 in 0.268s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-quobyte-068f94b6-4783-4c34-96cc-fefd98d847bc" released by "_delete_snapshot" :: held 1.647s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-quobyte-08ef1b5a-aec0-4311-81a5-a4db611fa279" released by "delete_snapshot" :: held 1.674s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Created reservations ['00183ada-8a1d-4fa0-b5d3-eda2e7dc9f30', 'dfce53af-7ed5-4a07-90ab-e142df85a1d1', 'dcb57361-4dfb-4613-a1da-a71cb0c91cf8', '3b7ff6d7-37ea-4f20-b1fc-d027acd97758'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:18 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Delete snapshot completed successfully. Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-faf82e09-00c6-47aa-869c-48af554322f0 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-068f94b6-4783-4c34-96cc-fefd98d847bc-delete_snapshot" released by "delete_snapshot" :: held 1.806s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:18 devstack sudo[109772]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-69db7435-7a97-42b1-8139-99497245beba 1073741824" returned: 0 in 0.444s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-69db7435-7a97-42b1-8139-99497245beba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:18 devstack sudo[109779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-69db7435-7a97-42b1-8139-99497245beba Aug 09 13:01:18 devstack sudo[109779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-67280eb0-d730-430a-ac8d-fb178a507a1e-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Lock "cinder-67280eb0-d730-430a-ac8d-fb178a507a1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-e73a2afa-3564-46aa-8da5-456dc19f9c03" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-e73a2afa-3564-46aa-8da5-456dc19f9c03" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-67280eb0-d730-430a-ac8d-fb178a507a1e" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-67280eb0-d730-430a-ac8d-fb178a507a1e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Deleting offline snapshot 67280eb0-d730-430a-ac8d-fb178a507a1e of volume e73a2afa-3564-46aa-8da5-456dc19f9c03 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] snapshot_file for this snap is: volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d863616-2f79-4bfe-a5a6-eb8f681ec7c7]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "cinder-08ef1b5a-aec0-4311-81a5-a4db611fa279-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-08ef1b5a-aec0-4311-81a5-a4db611fa279-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "cinder-quobyte-08ef1b5a-aec0-4311-81a5-a4db611fa279" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:19 devstack sudo[109779]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-69db7435-7a97-42b1-8139-99497245beba" returned: 0 in 0.284s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.771s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-quobyte-08ef1b5a-aec0-4311-81a5-a4db611fa279" acquired by "delete_volume" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:19 devstack sudo[109781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e Aug 09 13:01:19 devstack sudo[109781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31717ec6-5d93-4df8-85fa-0d8c2a9ae56e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69db7435-7a97-42b1-8139-99497245beba', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd70f103-c6aa-4c56-9b53-5a6f902f379c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[815cb1a3-1ecc-4c50-9a87-d69eab57b78a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:19 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Volume volume-69db7435-7a97-42b1-8139-99497245beba (69db7435-7a97-42b1-8139-99497245beba): created successfully Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd70f103-c6aa-4c56-9b53-5a6f902f379c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Flow 'volume_create_manager' (9b9d073e-70ae-4b43-9df9-7defec28f655) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:19 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-6dc76dc0-dfca-45eb-af4d-6ebc163f9518 tempest-ProjectReaderTests-755492137 None] Created volume successfully. Aug 09 13:01:19 devstack sudo[109784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 Aug 09 13:01:19 devstack sudo[109784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:19 devstack sudo[109781]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e" returned: 0 in 0.409s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e73a2afa-3564-46aa-8da5-456dc19f9c03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3115718b-3fdf-4938-b2bf-99dd70b2055d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:19 devstack sudo[109784]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:19 devstack sudo[109789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279" returned: 0 in 0.387s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:19 devstack sudo[109789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:19 devstack sudo[109793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279 Aug 09 13:01:19 devstack sudo[109793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:19 devstack sudo[109793]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:19 devstack sudo[109789]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03" returned: 0 in 0.377s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-08ef1b5a-aec0-4311-81a5-a4db611fa279" returned: 0 in 0.266s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:19 devstack sudo[109802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e Aug 09 13:01:19 devstack sudo[109802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-quobyte-08ef1b5a-aec0-4311-81a5-a4db611fa279" released by "delete_volume" :: held 0.743s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:19 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Created reservations ['de63fc73-66ec-4115-84b8-2623084e538c', 'bbe0c31b-1d93-441f-8c2e-d30176e47d22', '88e999c7-6ece-47f5-8a9c-3f2e9dc518bd', '31e14ba2-6a43-468c-95df-8e646ad062d3'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:20 devstack sudo[109808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:20 devstack sudo[109808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "cinder-f741204d-f88f-4038-ad56-e80ee7b70c94-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:20 devstack sudo[109802]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-f741204d-f88f-4038-ad56-e80ee7b70c94-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e" returned: 0 in 0.429s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:20 devstack sudo[109810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e Aug 09 13:01:20 devstack sudo[109810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "cinder-quobyte-f741204d-f88f-4038-ad56-e80ee7b70c94" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-quobyte-f741204d-f88f-4038-ad56-e80ee7b70c94" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c31828-c040-49f1-8ab2-74d48fb1ccb3]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:20 devstack sudo[109808]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.324s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:20 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Deleted volume successfully. Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-8098767c-188a-4b7c-9c95-f5079ca20aa5 tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-08ef1b5a-aec0-4311-81a5-a4db611fa279-delete_volume" released by "delete_volume" :: held 1.448s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:20 devstack sudo[109812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94 Aug 09 13:01:20 devstack sudo[109812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:20 devstack sudo[109810]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03.67280eb0-d730-430a-ac8d-fb178a507a1e" returned: 0 in 0.291s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-67280eb0-d730-430a-ac8d-fb178a507a1e" released by "_delete_snapshot" :: held 1.614s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-e73a2afa-3564-46aa-8da5-456dc19f9c03" released by "delete_snapshot" :: held 1.642s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Created reservations ['bc873cff-e4ad-461e-a7e4-d1bf9d3cb194', '5ab8b68f-5dc9-4e91-a9d5-74de13e81295', '47ba4bb7-1d22-4582-8289-931a93c3ea5c', '0f8efcf2-5e51-432a-b586-02c964e42983'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:20 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Delete snapshot completed successfully. Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-d3889bfe-0ee2-471d-9b3e-70c9702a8657 tempest-ProjectReaderTests-201724270 None] Lock "cinder-67280eb0-d730-430a-ac8d-fb178a507a1e-delete_snapshot" released by "delete_snapshot" :: held 1.790s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Acquiring lock "cinder-69db7435-7a97-42b1-8139-99497245beba-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Lock "cinder-69db7435-7a97-42b1-8139-99497245beba-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Acquiring lock "cinder-quobyte-69db7435-7a97-42b1-8139-99497245beba" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Lock "cinder-quobyte-69db7435-7a97-42b1-8139-99497245beba" acquired by "delete_volume" :: waited 0.014s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:20 devstack sudo[109812]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94" returned: 0 in 0.461s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfa9337-a7f5-4a80-b2ad-b4b2a7e4fa6d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-69db7435-7a97-42b1-8139-99497245beba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:20 devstack sudo[109820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94 Aug 09 13:01:20 devstack sudo[109820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:20 devstack sudo[109821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-69db7435-7a97-42b1-8139-99497245beba Aug 09 13:01:20 devstack sudo[109821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:21 devstack sudo[109820]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-f741204d-f88f-4038-ad56-e80ee7b70c94" returned: 0 in 0.251s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-quobyte-f741204d-f88f-4038-ad56-e80ee7b70c94" released by "delete_volume" :: held 0.768s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-e73a2afa-3564-46aa-8da5-456dc19f9c03-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Lock "cinder-e73a2afa-3564-46aa-8da5-456dc19f9c03-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Created reservations ['0e590b22-968f-4706-af6c-9c6c6cb8b89a', 'ca9f6247-95d9-4e19-b281-f0eea02e7d8d', '2289d96f-866c-4835-85fb-508b349baa4d', '3790b07f-c85f-446b-949a-6a86722398e7'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Acquiring lock "cinder-quobyte-e73a2afa-3564-46aa-8da5-456dc19f9c03" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-e73a2afa-3564-46aa-8da5-456dc19f9c03" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:21 devstack sudo[109821]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d63c9f1e-fcc7-4769-814d-0c2ab3fdcebb]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-69db7435-7a97-42b1-8139-99497245beba" returned: 0 in 0.440s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-69db7435-7a97-42b1-8139-99497245beba {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:21 devstack sudo[109829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-69db7435-7a97-42b1-8139-99497245beba Aug 09 13:01:21 devstack sudo[109829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:21 devstack sudo[109831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:21 devstack sudo[109831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:21 devstack sudo[109828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 Aug 09 13:01:21 devstack sudo[109828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:21 devstack sudo[109829]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-69db7435-7a97-42b1-8139-99497245beba" returned: 0 in 0.319s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Lock "cinder-quobyte-69db7435-7a97-42b1-8139-99497245beba" released by "delete_volume" :: held 0.828s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:21 devstack sudo[109831]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.312s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:21 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Deleted volume successfully. Aug 09 13:01:21 devstack sudo[109828]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03" returned: 0 in 0.414s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0d4d1c86-f21a-4163-a62e-f3779cf093ff tempest-VolumeDependencyTests-1134504077 None] Lock "cinder-f741204d-f88f-4038-ad56-e80ee7b70c94-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:21 devstack sudo[109839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03 Aug 09 13:01:21 devstack sudo[109839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Created reservations ['403902d6-a2fb-4e7e-88f7-9ffa06eafc25', '8a5da4d5-760a-48b5-8e51-a30ab146bc50', '839092cc-a0d6-4644-9cd8-fd2cdcf95732', '1f0f1808-f5ea-4eab-88f8-791fcf317239'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:21 devstack sudo[109841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:21 devstack sudo[109841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:21 devstack sudo[109839]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-e73a2afa-3564-46aa-8da5-456dc19f9c03" returned: 0 in 0.315s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Lock "cinder-quobyte-e73a2afa-3564-46aa-8da5-456dc19f9c03" released by "delete_volume" :: held 0.803s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Created reservations ['300f756a-166a-4e2b-a431-56468d33e1fd', 'f66c2e04-6122-4dc6-ad5b-6bf1429b3c1f', '653e0934-c9d2-4b9e-8602-2faad40abb6c', 'dbb5e99a-90f8-422d-a063-e79415a3bf1a'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:22 devstack sudo[109841]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.315s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Deleted volume successfully. Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-df40aba8-bf6f-4094-b8d1-7f38ff9996a7 tempest-ProjectReaderTests-755492137 None] Lock "cinder-69db7435-7a97-42b1-8139-99497245beba-delete_volume" released by "delete_volume" :: held 1.419s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:22 devstack sudo[109845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:22 devstack sudo[109845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Flow 'volume_create_manager' (2510d0a9-5e26-44ca-9b11-355298963010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74067dbf-547b-4dca-91e7-01483bc60f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:22 devstack sudo[109845]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.336s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Deleted volume successfully. Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74067dbf-547b-4dca-91e7-01483bc60f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-350117514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ea24fc-ee1b-4c70-b522-2bf01a9066a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6229b7ce0b914c8297617befb1085bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:22Z,use_quota=True,user_id='0de5568a36db4c2da27c57fed83da7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d656ff8e-07ed-4bd6-b6ad-9dcd85f32a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d656ff8e-07ed-4bd6-b6ad-9dcd85f32a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b5266f-4b5b-40aa-b982-e14d1f581455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51b5266f-4b5b-40aa-b982-e14d1f581455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0ea24fc-ee1b-4c70-b522-2bf01a9066a8', 'volume_name': 'volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886f70d9-96ac-4ff6-b795-95d1f29eb1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (886f70d9-96ac-4ff6-b795-95d1f29eb1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111f60e0-7c6e-41a5-b1f5-724080dbc4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:22 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Volume d0ea24fc-ee1b-4c70-b522-2bf01a9066a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8', 'volume_size': 1} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-350117514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0ea24fc-ee1b-4c70-b522-2bf01a9066a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6229b7ce0b914c8297617befb1085bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:22Z,use_quota=True,user_id='0de5568a36db4c2da27c57fed83da7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Creating volume d0ea24fc-ee1b-4c70-b522-2bf01a9066a8 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:01:22 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-0e6462f5-142b-4f49-b763-1b963c64e8db tempest-ProjectReaderTests-201724270 None] Lock "cinder-e73a2afa-3564-46aa-8da5-456dc19f9c03-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:22 devstack sudo[109848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8 1073741824 Aug 09 13:01:22 devstack sudo[109848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:23 devstack sudo[109848]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8 1073741824" returned: 0 in 0.535s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:23 devstack sudo[109854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8 Aug 09 13:01:23 devstack sudo[109854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:23 devstack sudo[109854]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8" returned: 0 in 0.305s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:01:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (111f60e0-7c6e-41a5-b1f5-724080dbc4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96046b3-c3ec-49d6-bcf1-2ae818913a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:23 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Volume volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8 (d0ea24fc-ee1b-4c70-b522-2bf01a9066a8): created successfully Aug 09 13:01:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d96046b3-c3ec-49d6-bcf1-2ae818913a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Flow 'volume_create_manager' (2510d0a9-5e26-44ca-9b11-355298963010) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:23 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-02e6a017-3635-41e6-b8b3-5a8e1cd113b4 tempest-ProjectReaderTests-755492137 None] Created volume successfully. Aug 09 13:01:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Acquiring lock "cinder-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Lock "cinder-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Acquiring lock "cinder-quobyte-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:24 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Lock "cinder-quobyte-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8" acquired by "delete_volume" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:24 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ae6d6c8-7032-4790-8ce8-1438c8d9e480]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:24 devstack sudo[109857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8 Aug 09 13:01:24 devstack sudo[109857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-824a6940-72ff-4a4c-99e0-f05eeac251ea tempest-ProjectAdminTests-423692818 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7576332092285, 'free_capacity_gb': 1775.7576332092285, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=89309) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Aug 09 13:01:25 devstack sudo[109857]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8" returned: 0 in 0.415s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:25 devstack sudo[109862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8 Aug 09 13:01:25 devstack sudo[109862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:25 devstack sudo[109862]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8" returned: 0 in 0.280s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Lock "cinder-quobyte-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8" released by "delete_volume" :: held 0.758s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Created reservations ['06db7aa7-e5f2-40ec-8cf2-56b9fa76b578', 'cd08739c-5b82-4bed-828f-53fbcea910d8', 'b2db1492-0b9f-43c9-9eb7-abb7defe55cc', '9bad6b20-b697-48ae-8097-454312547f4c'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:25 devstack sudo[109865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:25 devstack sudo[109865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:25 devstack sudo[109865]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.258s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:25 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Deleted volume successfully. Aug 09 13:01:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-2c066995-6665-4bb4-940c-b1d775234b0a tempest-ProjectReaderTests-755492137 None] Lock "cinder-d0ea24fc-ee1b-4c70-b522-2bf01a9066a8-delete_volume" released by "delete_volume" :: held 1.256s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Flow 'volume_create_manager' (cab124cd-4bd4-475c-bd28-25696fc50b87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e770dce-e0c1-47c1-a188-7a453f0bfffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e770dce-e0c1-47c1-a188-7a453f0bfffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-210094973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7487583a-5e7a-4177-a2ae-880bab3c089a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6229b7ce0b914c8297617befb1085bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:26Z,use_quota=True,user_id='0de5568a36db4c2da27c57fed83da7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df066d63-7835-4d56-9728-43703799c94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df066d63-7835-4d56-9728-43703799c94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d884b909-bf8a-4f0a-a99e-e74d89a59a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d884b909-bf8a-4f0a-a99e-e74d89a59a43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7487583a-5e7a-4177-a2ae-880bab3c089a', 'volume_name': 'volume-7487583a-5e7a-4177-a2ae-880bab3c089a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbb11db-a366-4be0-b000-0234e9c9b4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecbb11db-a366-4be0-b000-0234e9c9b4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f844c3e7-7867-4e64-81a5-bc20f715c18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:26 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Volume 7487583a-5e7a-4177-a2ae-880bab3c089a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7487583a-5e7a-4177-a2ae-880bab3c089a', 'volume_size': 1} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-210094973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7487583a-5e7a-4177-a2ae-880bab3c089a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6229b7ce0b914c8297617befb1085bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:26Z,use_quota=True,user_id='0de5568a36db4c2da27c57fed83da7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Creating volume 7487583a-5e7a-4177-a2ae-880bab3c089a {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:01:26 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7487583a-5e7a-4177-a2ae-880bab3c089a 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:26 devstack sudo[109868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7487583a-5e7a-4177-a2ae-880bab3c089a 1073741824 Aug 09 13:01:26 devstack sudo[109868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Flow 'volume_create_manager' (82b5a4b3-a508-474f-abd7-a27462874abd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3cb292-4f99-427a-8d75-0e7af0ec5ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c3cb292-4f99-427a-8d75-0e7af0ec5ab6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-605966796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfcbcff-27f6-43b8-a5bd-4884b384a91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18420e9207694ded901360ac7483438a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:27Z,use_quota=True,user_id='02aff3c6c17048b783d728a507ef64eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d033aecf-b0f9-4a20-94e0-5b4414581b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d033aecf-b0f9-4a20-94e0-5b4414581b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d798dd-9e89-4287-98a5-a5d9612ac4ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8d798dd-9e89-4287-98a5-a5d9612ac4ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cfcbcff-27f6-43b8-a5bd-4884b384a91a', 'volume_name': 'volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26aaed98-aef2-4a55-b7fc-1aef4a21b836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26aaed98-aef2-4a55-b7fc-1aef4a21b836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915e9747-f103-4ac3-be8d-3818f08b156a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:26 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Volume 3cfcbcff-27f6-43b8-a5bd-4884b384a91a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a', 'volume_size': 1} Aug 09 13:01:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:26 devstack sudo[109868]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7487583a-5e7a-4177-a2ae-880bab3c089a 1073741824" returned: 0 in 0.480s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7487583a-5e7a-4177-a2ae-880bab3c089a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:27 devstack sudo[109874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7487583a-5e7a-4177-a2ae-880bab3c089a Aug 09 13:01:27 devstack sudo[109874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:27 devstack sudo[109874]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7487583a-5e7a-4177-a2ae-880bab3c089a" returned: 0 in 0.258s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.335s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-605966796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cfcbcff-27f6-43b8-a5bd-4884b384a91a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18420e9207694ded901360ac7483438a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:27Z,use_quota=True,user_id='02aff3c6c17048b783d728a507ef64eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Creating volume 3cfcbcff-27f6-43b8-a5bd-4884b384a91a {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:01:27 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f844c3e7-7867-4e64-81a5-bc20f715c18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7487583a-5e7a-4177-a2ae-880bab3c089a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:27 devstack sudo[109877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a 1073741824 Aug 09 13:01:27 devstack sudo[109877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b163a37-1d61-4785-8a65-fbabf71bbd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:27 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Volume volume-7487583a-5e7a-4177-a2ae-880bab3c089a (7487583a-5e7a-4177-a2ae-880bab3c089a): created successfully Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b163a37-1d61-4785-8a65-fbabf71bbd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Flow 'volume_create_manager' (cab124cd-4bd4-475c-bd28-25696fc50b87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:27 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1937d3b3-e564-4e7f-a8f3-ceb288f316b3 tempest-ProjectReaderTests-755492137 None] Created volume successfully. Aug 09 13:01:27 devstack sudo[109877]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a 1073741824" returned: 0 in 0.434s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:27 devstack sudo[109883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a Aug 09 13:01:27 devstack sudo[109883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:28 devstack sudo[109883]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a" returned: 0 in 0.258s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] <== create_volume: return (737ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:01:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.740s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (915e9747-f103-4ac3-be8d-3818f08b156a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e808f496-3929-4405-aa56-ecfa9d2516c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:28 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Volume volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a (3cfcbcff-27f6-43b8-a5bd-4884b384a91a): created successfully Aug 09 13:01:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e808f496-3929-4405-aa56-ecfa9d2516c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:28 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Flow 'volume_create_manager' (82b5a4b3-a508-474f-abd7-a27462874abd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:28 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-827f5831-2719-4660-af92-36d51e9828a8 tempest-ProjectReaderTests-1620813688 None] Created volume successfully. Aug 09 13:01:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Acquiring lock "cinder-7487583a-5e7a-4177-a2ae-880bab3c089a-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Lock "cinder-7487583a-5e7a-4177-a2ae-880bab3c089a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Acquiring lock "cinder-quobyte-7487583a-5e7a-4177-a2ae-880bab3c089a" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Lock "cinder-quobyte-7487583a-5e7a-4177-a2ae-880bab3c089a" acquired by "delete_volume" :: waited 0.013s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:28 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[598ef516-92e1-41d5-b9c8-40072aab71a8]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7487583a-5e7a-4177-a2ae-880bab3c089a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:28 devstack sudo[109886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7487583a-5e7a-4177-a2ae-880bab3c089a Aug 09 13:01:28 devstack sudo[109886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:29 devstack sudo[109886]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7487583a-5e7a-4177-a2ae-880bab3c089a" returned: 0 in 0.399s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7487583a-5e7a-4177-a2ae-880bab3c089a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:29 devstack sudo[109891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7487583a-5e7a-4177-a2ae-880bab3c089a Aug 09 13:01:29 devstack sudo[109891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Acquiring lock "cinder-3cfcbcff-27f6-43b8-a5bd-4884b384a91a-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Lock "cinder-3cfcbcff-27f6-43b8-a5bd-4884b384a91a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Acquiring lock "cinder-quobyte-3cfcbcff-27f6-43b8-a5bd-4884b384a91a" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (57aaba14-3f20-4037-85aa-3ca8a2a220c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532e1384-4221-4187-952b-77f384f70a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:29 devstack sudo[109891]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Lock "cinder-quobyte-3cfcbcff-27f6-43b8-a5bd-4884b384a91a" acquired by "delete_volume" :: waited 0.055s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7487583a-5e7a-4177-a2ae-880bab3c089a" returned: 0 in 0.284s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0866d475-80b1-4f6f-afe7-796172d59307]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (532e1384-4221-4187-952b-77f384f70a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749922455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad1a2ee-48a1-4f8a-902e-d81ba3c35922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:29Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2367ff-0db7-43a3-bd78-a8a18d46a562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c2367ff-0db7-43a3-bd78-a8a18d46a562) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af160bf-285c-43ff-ba5c-a00a5315ba21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6af160bf-285c-43ff-ba5c-a00a5315ba21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ad1a2ee-48a1-4f8a-902e-d81ba3c35922', 'volume_name': 'volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800322bd-cce7-4aaa-a7b4-a76fa64147ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (800322bd-cce7-4aaa-a7b4-a76fa64147ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f68b9c-d931-4cc5-9fc1-c9a0d450f5d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:29 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Volume 7ad1a2ee-48a1-4f8a-902e-d81ba3c35922: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922', 'volume_size': 1} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1749922455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad1a2ee-48a1-4f8a-902e-d81ba3c35922,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:29Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Creating volume 7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:01:29 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Lock "cinder-quobyte-7487583a-5e7a-4177-a2ae-880bab3c089a" released by "delete_volume" :: held 0.795s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:29 devstack sudo[109895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 1073741824 Aug 09 13:01:29 devstack sudo[109895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:29 devstack sudo[109894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a Aug 09 13:01:29 devstack sudo[109894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Created reservations ['aa987c4c-be42-4e48-9383-35b353be4e33', 'cff077d0-ba9a-482e-a33c-f42aedebeb96', '4324ede9-ad1d-4d6c-8865-55d5490a85ce', '40bfc687-7df6-4aef-9a72-427d6d057ec8'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:29 devstack sudo[109898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:29 devstack sudo[109898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:29 devstack sudo[109894]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a" returned: 0 in 0.404s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:29 devstack sudo[109906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a Aug 09 13:01:29 devstack sudo[109906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:29 devstack sudo[109898]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.288s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:29 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Deleted volume successfully. Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b7ae3d46-d9bb-4d21-9e38-a99e3e016380 tempest-ProjectReaderTests-755492137 None] Lock "cinder-7487583a-5e7a-4177-a2ae-880bab3c089a-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:29 devstack sudo[109895]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 1073741824" returned: 0 in 0.528s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:29 devstack sudo[109911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 Aug 09 13:01:29 devstack sudo[109911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:29 devstack sudo[109906]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-3cfcbcff-27f6-43b8-a5bd-4884b384a91a" returned: 0 in 0.280s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Lock "cinder-quobyte-3cfcbcff-27f6-43b8-a5bd-4884b384a91a" released by "delete_volume" :: held 0.729s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Created reservations ['174fc793-bf1f-4ef9-8cbe-ac89447984d1', 'b76c43f2-9ac4-4f3f-845a-5ede24d5c813', '836067fd-17d7-44e1-ba87-3d7893592bb2', '680d953a-47b7-43b5-bcbf-03fad2dc0a26'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:30 devstack sudo[109913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:30 devstack sudo[109913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:30 devstack sudo[109911]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922" returned: 0 in 0.345s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3f68b9c-d931-4cc5-9fc1-c9a0d450f5d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498d6bea-bbee-4b4c-bac1-b1e344d0f909) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Flow 'volume_create_manager' (a3df9323-bf3f-406f-a9bd-9ca29b12689f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b098e33-d73e-4568-94d9-d4c41be02d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:30 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Volume volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 (7ad1a2ee-48a1-4f8a-902e-d81ba3c35922): created successfully Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (498d6bea-bbee-4b4c-bac1-b1e344d0f909) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (57aaba14-3f20-4037-85aa-3ca8a2a220c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8b098e33-d73e-4568-94d9-d4c41be02d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802650923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b392ff-f2b4-410a-9c41-b9c5af46f7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6229b7ce0b914c8297617befb1085bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:30Z,use_quota=True,user_id='0de5568a36db4c2da27c57fed83da7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (852bef4b-a7e3-4e8e-9b67-5df8c1082252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (852bef4b-a7e3-4e8e-9b67-5df8c1082252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c3ac9d-f4b6-4c68-b57a-6d6f9f5b3e57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35c3ac9d-f4b6-4c68-b57a-6d6f9f5b3e57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47b392ff-f2b4-410a-9c41-b9c5af46f7fe', 'volume_name': 'volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fec36df-5771-4021-83b9-9c73a3b8b12d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fec36df-5771-4021-83b9-9c73a3b8b12d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee69640-7d12-4168-ac86-1ba3d3f27a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:30 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Volume 47b392ff-f2b4-410a-9c41-b9c5af46f7fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe', 'volume_size': 1} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-802650923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47b392ff-f2b4-410a-9c41-b9c5af46f7fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6229b7ce0b914c8297617befb1085bb8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:30Z,use_quota=True,user_id='0de5568a36db4c2da27c57fed83da7ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Creating volume 47b392ff-f2b4-410a-9c41-b9c5af46f7fe {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:01:30 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:30 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-14338a37-b311-4937-949f-b0731248259d tempest-ProjectMemberTests-423308002 None] Created volume successfully. Aug 09 13:01:30 devstack sudo[109913]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.273s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:30 devstack sudo[109917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe 1073741824 Aug 09 13:01:30 devstack sudo[109917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:30 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Deleted volume successfully. Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-38d576a0-2d33-45e3-8071-cd95be25a93e tempest-ProjectReaderTests-1620813688 None] Lock "cinder-3cfcbcff-27f6-43b8-a5bd-4884b384a91a-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Flow 'volume_create_manager' (828c0b87-ee7d-4649-9701-e0059f5bc8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7cb0a3-3a98-4da4-9206-f1b15ebd5cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e7cb0a3-3a98-4da4-9206-f1b15ebd5cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-863602604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b10813a-17d3-403a-9093-8bb21821ec9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18420e9207694ded901360ac7483438a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:31Z,use_quota=True,user_id='02aff3c6c17048b783d728a507ef64eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7eacbd-c9e5-477b-9c10-51ad7ae4d7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c7eacbd-c9e5-477b-9c10-51ad7ae4d7bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac92fe5-ba22-4005-90f3-6b4768bdd9b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:30 devstack sudo[109917]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ac92fe5-ba22-4005-90f3-6b4768bdd9b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b10813a-17d3-403a-9093-8bb21821ec9f', 'volume_name': 'volume-2b10813a-17d3-403a-9093-8bb21821ec9f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca05a08-3ec8-493a-b4a4-4aaa9efe53dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ca05a08-3ec8-493a-b4a4-4aaa9efe53dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d845ecc-513e-442d-b2cf-22ae28f2ae31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:30 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Volume 2b10813a-17d3-403a-9093-8bb21821ec9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b10813a-17d3-403a-9093-8bb21821ec9f', 'volume_size': 1} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe 1073741824" returned: 0 in 0.476s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:30 devstack sudo[109923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe Aug 09 13:01:30 devstack sudo[109923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:31 devstack sudo[109923]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe" returned: 0 in 0.242s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.283s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-863602604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b10813a-17d3-403a-9093-8bb21821ec9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18420e9207694ded901360ac7483438a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:31Z,use_quota=True,user_id='02aff3c6c17048b783d728a507ef64eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Creating volume 2b10813a-17d3-403a-9093-8bb21821ec9f {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:01:31 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b10813a-17d3-403a-9093-8bb21821ec9f 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dee69640-7d12-4168-ac86-1ba3d3f27a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:31 devstack sudo[109926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b10813a-17d3-403a-9093-8bb21821ec9f 1073741824 Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463f84b6-4cf3-4e14-a568-a135d6ec4409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:31 devstack sudo[109926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:31 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Volume volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe (47b392ff-f2b4-410a-9c41-b9c5af46f7fe): created successfully Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463f84b6-4cf3-4e14-a568-a135d6ec4409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Flow 'volume_create_manager' (a3df9323-bf3f-406f-a9bd-9ca29b12689f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:31 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-6af137ea-1eab-4ef6-a5e7-d92b74aa0b11 tempest-ProjectReaderTests-755492137 None] Created volume successfully. Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:31 devstack sudo[109926]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b10813a-17d3-403a-9093-8bb21821ec9f 1073741824" returned: 0 in 0.471s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b10813a-17d3-403a-9093-8bb21821ec9f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:31 devstack sudo[109932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b10813a-17d3-403a-9093-8bb21821ec9f Aug 09 13:01:31 devstack sudo[109932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:31 devstack sudo[109932]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b10813a-17d3-403a-9093-8bb21821ec9f" returned: 0 in 0.239s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.341s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d845ecc-513e-442d-b2cf-22ae28f2ae31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b10813a-17d3-403a-9093-8bb21821ec9f', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a0a135-a8c7-4c85-8111-851badd71631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] Creating offline snapshot edacf5ed-3489-4554-b9a2-30d475fcd322 of volume 7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:01:31 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Volume volume-2b10813a-17d3-403a-9093-8bb21821ec9f (2b10813a-17d3-403a-9093-8bb21821ec9f): created successfully Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a0a135-a8c7-4c85-8111-851badd71631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Flow 'volume_create_manager' (828c0b87-ee7d-4649-9701-e0059f5bc8d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e1d93d2-972e-46e3-a9ce-a099049fd7b5]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:32 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b85c43eb-2f7b-4800-a1de-e212d7b44bdd tempest-ProjectReaderTests-1620813688 None] Created volume successfully. Aug 09 13:01:32 devstack sudo[109935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 Aug 09 13:01:32 devstack sudo[109935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:32 devstack sudo[109935]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922" returned: 0 in 0.362s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:32 devstack sudo[109940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 1G Aug 09 13:01:32 devstack sudo[109940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Acquiring lock "cinder-47b392ff-f2b4-410a-9c41-b9c5af46f7fe-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Lock "cinder-47b392ff-f2b4-410a-9c41-b9c5af46f7fe-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Acquiring lock "cinder-quobyte-47b392ff-f2b4-410a-9c41-b9c5af46f7fe" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Lock "cinder-quobyte-47b392ff-f2b4-410a-9c41-b9c5af46f7fe" acquired by "delete_volume" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b2ab87-4ac8-4ff4-8d71-6f3187975145]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:32 devstack sudo[109942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe Aug 09 13:01:32 devstack sudo[109942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:32 devstack sudo[109940]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 1G" returned: 0 in 0.420s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:32 devstack sudo[109947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 Aug 09 13:01:32 devstack sudo[109947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:32 devstack sudo[109942]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe" returned: 0 in 0.400s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Acquiring lock "cinder-2b10813a-17d3-403a-9093-8bb21821ec9f-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:32 devstack sudo[109952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe Aug 09 13:01:32 devstack sudo[109952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Lock "cinder-2b10813a-17d3-403a-9093-8bb21821ec9f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Acquiring lock "cinder-quobyte-2b10813a-17d3-403a-9093-8bb21821ec9f" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Lock "cinder-quobyte-2b10813a-17d3-403a-9093-8bb21821ec9f" acquired by "delete_volume" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd65459d-b1c8-4c47-8aa0-681827f99428]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b10813a-17d3-403a-9093-8bb21821ec9f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:33 devstack sudo[109947]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322" returned: 0 in 0.316s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:33 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 is being set with open permissions: ugo+rw Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:33 devstack sudo[109958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 Aug 09 13:01:33 devstack sudo[109958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:33 devstack sudo[109957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b10813a-17d3-403a-9093-8bb21821ec9f Aug 09 13:01:33 devstack sudo[109957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:33 devstack sudo[109952]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-47b392ff-f2b4-410a-9c41-b9c5af46f7fe" returned: 0 in 0.290s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Lock "cinder-quobyte-47b392ff-f2b4-410a-9c41-b9c5af46f7fe" released by "delete_volume" :: held 0.737s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Created reservations ['ca839955-3171-4f04-92c1-a6c99f38135a', '1fd82c0f-eabb-4190-8bd4-f1ce3464bb5f', '7c1d578d-1911-405b-8488-1cd5b2462f03', '4e7e7976-20ea-4f18-a074-cd8152c555a3'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:33 devstack sudo[109958]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322" returned: 0 in 0.263s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:33 devstack sudo[109963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:33 devstack sudo[109963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:33 devstack sudo[109968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.info Aug 09 13:01:33 devstack sudo[109968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:33 devstack sudo[109957]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b10813a-17d3-403a-9093-8bb21821ec9f" returned: 0 in 0.404s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b10813a-17d3-403a-9093-8bb21821ec9f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:33 devstack sudo[109970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b10813a-17d3-403a-9093-8bb21821ec9f Aug 09 13:01:33 devstack sudo[109970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:33 devstack sudo[109963]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.259s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:33 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Deleted volume successfully. Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-6d8eb852-9df4-4379-b499-11d27f072765 tempest-ProjectReaderTests-755492137 None] Lock "cinder-47b392ff-f2b4-410a-9c41-b9c5af46f7fe-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:33 devstack sudo[109968]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.info" returned: 0 in 0.298s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:33 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.info is being set with open permissions: ugo+rw Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:33 devstack sudo[109974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.info Aug 09 13:01:33 devstack sudo[109974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:33 devstack sudo[109970]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-2b10813a-17d3-403a-9093-8bb21821ec9f" returned: 0 in 0.310s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Lock "cinder-quobyte-2b10813a-17d3-403a-9093-8bb21821ec9f" released by "delete_volume" :: held 0.763s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Created reservations ['7ea6963f-21be-4e25-8bd7-4aa446b9dec3', '853e900d-c236-4a06-9624-421c83dd1ed0', 'bbb8526e-b0f6-4cd5-b6ff-3ebc7be2c4bc', 'fb9f9be0-ea26-44b6-99e8-464d427b8790'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:33 devstack sudo[109977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:33 devstack sudo[109977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:33 devstack sudo[109974]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.info" returned: 0 in 0.277s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.060s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:34 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-08630a33-3359-427e-9e36-1b7d5ef5a1ce tempest-ProjectMemberTests-423308002 None] Create snapshot completed successfully Aug 09 13:01:34 devstack sudo[109977]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.282s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:34 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:34 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Deleted volume successfully. Aug 09 13:01:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-270d8b85-92b1-4522-b759-bc43df4f6b2b tempest-ProjectReaderTests-1620813688 None] Lock "cinder-2b10813a-17d3-403a-9093-8bb21821ec9f-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-edacf5ed-3489-4554-b9a2-30d475fcd322-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Lock "cinder-edacf5ed-3489-4554-b9a2-30d475fcd322-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922" acquired by "delete_snapshot" :: waited 0.030s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-edacf5ed-3489-4554-b9a2-30d475fcd322" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-edacf5ed-3489-4554-b9a2-30d475fcd322" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Deleting offline snapshot edacf5ed-3489-4554-b9a2-30d475fcd322 of volume 7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:01:34 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] snapshot_file for this snap is: volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:01:34 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65ec76d-176a-4f5b-b1fa-63459019da57]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:35 devstack sudo[109981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 Aug 09 13:01:35 devstack sudo[109981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:35 devstack sudo[109981]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322" returned: 0 in 0.414s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:01:35 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[44cdb689-ea17-447e-971d-38d01757dbf7]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:35 devstack sudo[109986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 Aug 09 13:01:35 devstack sudo[109986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:35 devstack sudo[109986]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922" returned: 0 in 0.433s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:35 devstack sudo[109992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 Aug 09 13:01:35 devstack sudo[109992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:36 devstack sudo[109992]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322" returned: 0 in 0.371s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:36 devstack sudo[109998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322 Aug 09 13:01:36 devstack sudo[109998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:36 devstack sudo[109998]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922.edacf5ed-3489-4554-b9a2-30d475fcd322" returned: 0 in 0.256s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-edacf5ed-3489-4554-b9a2-30d475fcd322" released by "_delete_snapshot" :: held 1.613s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922" released by "delete_snapshot" :: held 1.636s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:36 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Created reservations ['77ace98c-acba-4ac9-81b7-f661d25fe732', '5f052642-c165-416d-b7c3-8517960818e7', '153c897e-8364-4421-a838-3d02c4f14fac', '9647e442-ff61-4c2a-b378-d1c7494e70e1'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:36 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Delete snapshot completed successfully. Aug 09 13:01:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-22de56a2-9386-40fe-9882-9cd9fad6f287 tempest-ProjectMemberTests-423308002 None] Lock "cinder-edacf5ed-3489-4554-b9a2-30d475fcd322-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Lock "cinder-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922" acquired by "delete_volume" :: waited 0.021s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5080fe-ea13-41f3-a416-9b346267033b]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:37 devstack sudo[110001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 Aug 09 13:01:37 devstack sudo[110001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:37 devstack sudo[110001]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922" returned: 0 in 0.412s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:37 devstack sudo[110006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922 Aug 09 13:01:37 devstack sudo[110006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:37 devstack sudo[110006]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922" returned: 0 in 0.269s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922" released by "delete_volume" :: held 0.742s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Created reservations ['2d77c9cf-2104-44ed-8f49-24d3ef062147', '38f8aae1-877b-4787-b61a-6c5c2ee3ab09', '399ab3d3-350c-42c2-8f3a-1750fafd5a98', '057eb45d-68d9-4381-84cd-54ba87e2892c'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:37 devstack sudo[110009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:37 devstack sudo[110009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:38 devstack sudo[110009]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.272s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:38 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Deleted volume successfully. Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1857a692-509c-4487-ab61-e7e9d01653d2 tempest-ProjectMemberTests-423308002 None] Lock "cinder-7ad1a2ee-48a1-4f8a-902e-d81ba3c35922-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (86a9a496-44d5-4690-b99a-dd3f0ed360e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad7768a-95d1-42d7-9d50-c006a5b6aa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ad7768a-95d1-42d7-9d50-c006a5b6aa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138129134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b7cfea-c8b7-49c7-813f-00e821382817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:39Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0680a128-be13-4616-8cde-cea648577adb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0680a128-be13-4616-8cde-cea648577adb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594dd7c2-5355-474a-ae84-be0ea119bbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (594dd7c2-5355-474a-ae84-be0ea119bbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17b7cfea-c8b7-49c7-813f-00e821382817', 'volume_name': 'volume-17b7cfea-c8b7-49c7-813f-00e821382817', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c49035-37c6-436b-8f40-9dcf6fdfac43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5c49035-37c6-436b-8f40-9dcf6fdfac43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e230d65b-cbec-44b2-9ad1-c8fcc2bf6c2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:38 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Volume 17b7cfea-c8b7-49c7-813f-00e821382817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17b7cfea-c8b7-49c7-813f-00e821382817', 'volume_size': 1} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2138129134',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17b7cfea-c8b7-49c7-813f-00e821382817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:39Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Creating volume 17b7cfea-c8b7-49c7-813f-00e821382817 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:01:38 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:01:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:38 devstack sudo[110012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817 1073741824 Aug 09 13:01:38 devstack sudo[110012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:39 devstack sudo[110012]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817 1073741824" returned: 0 in 0.435s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:39 devstack sudo[110018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817 Aug 09 13:01:39 devstack sudo[110018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:39 devstack sudo[110018]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817" returned: 0 in 0.263s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e230d65b-cbec-44b2-9ad1-c8fcc2bf6c2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17b7cfea-c8b7-49c7-813f-00e821382817', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8c4e94-ec86-4be4-88be-f150cb396acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:39 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Volume volume-17b7cfea-c8b7-49c7-813f-00e821382817 (17b7cfea-c8b7-49c7-813f-00e821382817): created successfully Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a8c4e94-ec86-4be4-88be-f150cb396acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (86a9a496-44d5-4690-b99a-dd3f0ed360e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:39 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4bfd6e9a-e685-4efa-9a26-fa5efee2d349 tempest-ProjectMemberTests-423308002 None] Created volume successfully. Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] Creating offline snapshot eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd of volume 17b7cfea-c8b7-49c7-813f-00e821382817 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6989f59d-4615-49bb-a0d6-199f39da1d52]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:39 devstack sudo[110021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817 Aug 09 13:01:39 devstack sudo[110021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:40 devstack sudo[110021]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817" returned: 0 in 0.395s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:40 devstack sudo[110026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd 1G Aug 09 13:01:40 devstack sudo[110026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:40 devstack sudo[110026]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd 1G" returned: 0 in 0.435s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b7cfea-c8b7-49c7-813f-00e821382817 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:40 devstack sudo[110032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b7cfea-c8b7-49c7-813f-00e821382817 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd Aug 09 13:01:40 devstack sudo[110032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:40 devstack sudo[110032]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17b7cfea-c8b7-49c7-813f-00e821382817 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd" returned: 0 in 0.300s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:40 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd is being set with open permissions: ugo+rw Aug 09 13:01:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:41 devstack sudo[110037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd Aug 09 13:01:41 devstack sudo[110037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:41 devstack sudo[110037]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd" returned: 0 in 0.251s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:41 devstack sudo[110040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.info Aug 09 13:01:41 devstack sudo[110040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:41 devstack sudo[110040]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.info" returned: 0 in 0.261s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:41 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.info is being set with open permissions: ugo+rw Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:41 devstack sudo[110043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.info Aug 09 13:01:41 devstack sudo[110043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:41 devstack sudo[110043]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.info" returned: 0 in 0.253s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.976s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:41 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e07e4937-948b-42b9-a999-0da4eb11e2ca tempest-ProjectMemberTests-423308002 None] Create snapshot completed successfully Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Lock "cinder-eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-17b7cfea-c8b7-49c7-813f-00e821382817" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-17b7cfea-c8b7-49c7-813f-00e821382817" acquired by "delete_snapshot" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Deleting offline snapshot eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd of volume 17b7cfea-c8b7-49c7-813f-00e821382817 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:01:41 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] snapshot_file for this snap is: volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:01:42 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d165e9-be71-44b9-bc42-cfa31d5351ce]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:42 devstack sudo[110046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd Aug 09 13:01:42 devstack sudo[110046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:42 devstack sudo[110046]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd" returned: 0 in 0.381s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:42 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17b7cfea-c8b7-49c7-813f-00e821382817(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:01:42 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d789a019-8e46-4281-9943-8d6e83dd3afc]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:42 devstack sudo[110051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817 Aug 09 13:01:42 devstack sudo[110051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:42 devstack sudo[110051]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817" returned: 0 in 0.399s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:42 devstack sudo[110056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd Aug 09 13:01:42 devstack sudo[110056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:43 devstack sudo[110056]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd" returned: 0 in 0.337s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:43 devstack sudo[110061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd Aug 09 13:01:43 devstack sudo[110061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:43 devstack sudo[110061]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817.eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd" returned: 0 in 0.249s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd" released by "_delete_snapshot" :: held 1.492s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-17b7cfea-c8b7-49c7-813f-00e821382817" released by "delete_snapshot" :: held 1.520s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:43 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Created reservations ['17993c70-7ca5-4891-ba29-7d5308879895', 'e3384de2-336e-44e5-87b4-4cc5a507eb83', '7e08e3ca-4c2c-4238-a5c3-4c1aa7453b73', '156f61d1-e807-430e-aff7-5bbd2e9bb547'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:43 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Delete snapshot completed successfully. Aug 09 13:01:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7bbd9936-0b50-4da8-a1f8-2244b433fe1f tempest-ProjectMemberTests-423308002 None] Lock "cinder-eb2fb3ce-7400-4eb8-a9e3-a31ae173f5bd-delete_snapshot" released by "delete_snapshot" :: held 1.687s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-17b7cfea-c8b7-49c7-813f-00e821382817-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Lock "cinder-17b7cfea-c8b7-49c7-813f-00e821382817-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-17b7cfea-c8b7-49c7-813f-00e821382817" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-17b7cfea-c8b7-49c7-813f-00e821382817" acquired by "delete_volume" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:44 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee99ee8f-7bcd-4b50-a3a9-148a6eafe5f7]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:44 devstack sudo[110064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817 Aug 09 13:01:44 devstack sudo[110064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:44 devstack sudo[110064]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817" returned: 0 in 0.384s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:44 devstack sudo[110069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817 Aug 09 13:01:44 devstack sudo[110069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:44 devstack sudo[110069]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:44 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-17b7cfea-c8b7-49c7-813f-00e821382817" returned: 0 in 0.269s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:44 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-17b7cfea-c8b7-49c7-813f-00e821382817" released by "delete_volume" :: held 0.742s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Created reservations ['4ca8304f-bf61-4840-922f-539b459d03d1', '9e0954bc-92dc-4aeb-8542-2aab4e9de885', '7fef4c26-e4ed-4365-b598-9d8e39c238e5', '2009b433-f792-4796-8315-f0414f0b07d9'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:45 devstack sudo[110073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:45 devstack sudo[110073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:45 devstack sudo[110073]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.267s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:45 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Deleted volume successfully. Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-53ff7ef5-338c-4ff1-a501-8be0fb73069a tempest-ProjectMemberTests-423308002 None] Lock "cinder-17b7cfea-c8b7-49c7-813f-00e821382817-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (c7967785-07b2-4e76-aa1f-bf51b16259b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a873ee3b-1d35-464f-ab03-95f117bbb8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:45 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a873ee3b-1d35-464f-ab03-95f117bbb8c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537432756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964ec5d2-eda7-44d9-be6f-5028de317881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:46Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ce91d6-dcab-4145-aed4-06d4e53f0d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83ce91d6-dcab-4145-aed4-06d4e53f0d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c506a57-13f6-478d-87ab-bf74face3ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c506a57-13f6-478d-87ab-bf74face3ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '964ec5d2-eda7-44d9-be6f-5028de317881', 'volume_name': 'volume-964ec5d2-eda7-44d9-be6f-5028de317881', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de20b41-3de7-4616-b895-53659444deb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de20b41-3de7-4616-b895-53659444deb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d55479-7c0e-409f-b6ef-ae8793bc5bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:46 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Volume 964ec5d2-eda7-44d9-be6f-5028de317881: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-964ec5d2-eda7-44d9-be6f-5028de317881', 'volume_size': 1} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-537432756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=964ec5d2-eda7-44d9-be6f-5028de317881,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:46Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Creating volume 964ec5d2-eda7-44d9-be6f-5028de317881 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:01:46 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:46 devstack sudo[110076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881 1073741824 Aug 09 13:01:46 devstack sudo[110076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:46 devstack sudo[110076]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881 1073741824" returned: 0 in 0.501s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:46 devstack sudo[110085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881 Aug 09 13:01:46 devstack sudo[110085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:46 devstack sudo[110085]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881" returned: 0 in 0.260s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] <== create_volume: return (813ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21d55479-7c0e-409f-b6ef-ae8793bc5bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-964ec5d2-eda7-44d9-be6f-5028de317881', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454dbe04-58e7-440b-9bd3-69a5067ba1df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:46 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Volume volume-964ec5d2-eda7-44d9-be6f-5028de317881 (964ec5d2-eda7-44d9-be6f-5028de317881): created successfully Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (454dbe04-58e7-440b-9bd3-69a5067ba1df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:46 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (c7967785-07b2-4e76-aa1f-bf51b16259b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:46 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4ebcbcf8-e48d-4a34-bb3c-8a2e5f6b5d3e tempest-ProjectMemberTests-423308002 None] Created volume successfully. Aug 09 13:01:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:48 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] Creating offline snapshot 4824c5d6-939d-4634-ad99-246503e29562 of volume 964ec5d2-eda7-44d9-be6f-5028de317881 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:01:48 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9fd690-1aa2-4360-a4a1-406bf5ba8647]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:48 devstack sudo[110088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881 Aug 09 13:01:48 devstack sudo[110088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:48 devstack sudo[110088]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881" returned: 0 in 0.456s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:48 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:48 devstack sudo[110129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 1G Aug 09 13:01:48 devstack sudo[110129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:49 devstack sudo[110129]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 1G" returned: 0 in 0.455s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-964ec5d2-eda7-44d9-be6f-5028de317881 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:49 devstack sudo[110136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-964ec5d2-eda7-44d9-be6f-5028de317881 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 Aug 09 13:01:49 devstack sudo[110136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:49 devstack sudo[110136]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-964ec5d2-eda7-44d9-be6f-5028de317881 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562" returned: 0 in 0.360s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:49 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 is being set with open permissions: ugo+rw Aug 09 13:01:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:49 devstack sudo[110142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 Aug 09 13:01:49 devstack sudo[110142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:49 devstack sudo[110142]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562" returned: 0 in 0.348s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:49 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:49 devstack sudo[110145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.info Aug 09 13:01:49 devstack sudo[110145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:50 devstack sudo[110145]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.info" returned: 0 in 0.278s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:50 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.info is being set with open permissions: ugo+rw Aug 09 13:01:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:50 devstack sudo[110148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.info Aug 09 13:01:50 devstack sudo[110148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:50 devstack sudo[110148]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.info" returned: 0 in 0.285s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:50 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.282s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:50 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-47ced023-f179-488c-b0c4-54a1544d8e96 tempest-ProjectMemberTests-423308002 None] Create snapshot completed successfully Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-4824c5d6-939d-4634-ad99-246503e29562-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Lock "cinder-4824c5d6-939d-4634-ad99-246503e29562-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-964ec5d2-eda7-44d9-be6f-5028de317881" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-964ec5d2-eda7-44d9-be6f-5028de317881" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-4824c5d6-939d-4634-ad99-246503e29562" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-4824c5d6-939d-4634-ad99-246503e29562" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Deleting offline snapshot 4824c5d6-939d-4634-ad99-246503e29562 of volume 964ec5d2-eda7-44d9-be6f-5028de317881 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] snapshot_file for this snap is: volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[13200e3d-d6e8-40ee-bdba-527cebbe3850]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:51 devstack sudo[110153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 Aug 09 13:01:51 devstack sudo[110153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:51 devstack sudo[110153]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562" returned: 0 in 0.402s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-964ec5d2-eda7-44d9-be6f-5028de317881(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e04b24f8-d32e-4b6a-a877-c10d050aed6a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:51 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:52 devstack sudo[110158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881 Aug 09 13:01:52 devstack sudo[110158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:52 devstack sudo[110158]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881" returned: 0 in 0.373s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:52 devstack sudo[110163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 Aug 09 13:01:52 devstack sudo[110163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:52 devstack sudo[110163]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562" returned: 0 in 0.389s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:52 devstack sudo[110168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562 Aug 09 13:01:52 devstack sudo[110168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:52 devstack sudo[110168]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:52 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881.4824c5d6-939d-4634-ad99-246503e29562" returned: 0 in 0.262s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-4824c5d6-939d-4634-ad99-246503e29562" released by "_delete_snapshot" :: held 1.530s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-964ec5d2-eda7-44d9-be6f-5028de317881" released by "delete_snapshot" :: held 1.556s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:53 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Created reservations ['810382b1-75f9-4f4a-84f9-2176831863c5', 'fa5abdb7-d4f6-4733-810b-85b6575bc205', '37079496-9f1e-4607-8343-127dd39c26b1', '623bbe51-4b66-4fca-a1d9-40dfdf96257b'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:53 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Delete snapshot completed successfully. Aug 09 13:01:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-1f20228f-4122-4a7b-874d-ec50552b819e tempest-ProjectMemberTests-423308002 None] Lock "cinder-4824c5d6-939d-4634-ad99-246503e29562-delete_snapshot" released by "delete_snapshot" :: held 1.717s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-964ec5d2-eda7-44d9-be6f-5028de317881-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Lock "cinder-964ec5d2-eda7-44d9-be6f-5028de317881-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-964ec5d2-eda7-44d9-be6f-5028de317881" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:01:53 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-964ec5d2-eda7-44d9-be6f-5028de317881" acquired by "delete_volume" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:01:53 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5042cd35-a379-4f45-9d19-e9bc6bed0ab1]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:53 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:53 devstack sudo[110177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881 Aug 09 13:01:53 devstack sudo[110177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:54 devstack sudo[110177]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881" returned: 0 in 0.394s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:54 devstack sudo[110182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881 Aug 09 13:01:54 devstack sudo[110182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:54 devstack sudo[110182]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-964ec5d2-eda7-44d9-be6f-5028de317881" returned: 0 in 0.260s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-964ec5d2-eda7-44d9-be6f-5028de317881" released by "delete_volume" :: held 0.715s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Created reservations ['989d2df7-32b0-4231-a79c-3567e6cc27a3', 'ee0c8b32-0e31-40e7-8ecc-5ad684e0d709', 'a94082db-52c2-4bf2-8ac8-f11e7b2ffb17', 'b39af660-3692-4fb9-9a6b-2760b02482ff'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:54 devstack sudo[110185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:54 devstack sudo[110185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:54 devstack sudo[110185]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.256s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:54 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Deleted volume successfully. Aug 09 13:01:54 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-f2f28e95-6c33-4af0-8100-a47d2ed17d4b tempest-ProjectMemberTests-423308002 None] Lock "cinder-964ec5d2-eda7-44d9-be6f-5028de317881-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (00651763-4ed8-4337-b2a9-7999b3446a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d7b4cc-0b48-43fa-99d8-c1de682320d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7d7b4cc-0b48-43fa-99d8-c1de682320d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836562362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b55df4d-40c0-4b3f-b0e0-524569513313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:55Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69e36d9-5742-4752-8f3b-4571ec0d7943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d69e36d9-5742-4752-8f3b-4571ec0d7943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c176160-25ba-4b8c-9a6a-f721aa798718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c176160-25ba-4b8c-9a6a-f721aa798718) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b55df4d-40c0-4b3f-b0e0-524569513313', 'volume_name': 'volume-9b55df4d-40c0-4b3f-b0e0-524569513313', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc5126c-d491-426f-8940-27008d1a3f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc5126c-d491-426f-8940-27008d1a3f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc261ef-6b42-486e-953e-24ff5c0b0917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:55 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Volume 9b55df4d-40c0-4b3f-b0e0-524569513313: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b55df4d-40c0-4b3f-b0e0-524569513313', 'volume_size': 1} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:01:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1836562362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b55df4d-40c0-4b3f-b0e0-524569513313,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:01:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:01:55Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Creating volume 9b55df4d-40c0-4b3f-b0e0-524569513313 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:01:55 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:55 devstack sudo[110189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313 1073741824 Aug 09 13:01:55 devstack sudo[110189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:55 devstack sudo[110189]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:55 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313 1073741824" returned: 0 in 0.478s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:56 devstack sudo[110195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313 Aug 09 13:01:56 devstack sudo[110195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:56 devstack sudo[110195]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313" returned: 0 in 0.293s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:56 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:01:56 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfc261ef-6b42-486e-953e-24ff5c0b0917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b55df4d-40c0-4b3f-b0e0-524569513313', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2e72b1-7abe-48ba-a7b4-3774f2902acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:01:56 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Volume volume-9b55df4d-40c0-4b3f-b0e0-524569513313 (9b55df4d-40c0-4b3f-b0e0-524569513313): created successfully Aug 09 13:01:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2e72b1-7abe-48ba-a7b4-3774f2902acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:01:56 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (00651763-4ed8-4337-b2a9-7999b3446a26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:01:56 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-082d79ad-552b-4d16-8d9c-879e2ca382f5 tempest-ProjectMemberTests-423308002 None] Created volume successfully. Aug 09 13:01:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] Creating offline snapshot ae5d8f3b-e526-4338-a450-1d7a10ce09e4 of volume 9b55df4d-40c0-4b3f-b0e0-524569513313 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:01:57 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8351fc8-33a5-48c4-b1b5-72705202ec21]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:01:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 13:01:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:01:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:01:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:01:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:01:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:57 devstack sudo[110198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313 Aug 09 13:01:57 devstack sudo[110198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:57 devstack sudo[110199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:01:57 devstack sudo[110199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:58 devstack sudo[110199]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.286s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:01:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 13:01:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 13:01:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Aug 09 13:01:58 devstack sudo[110198]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313" returned: 0 in 0.423s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:58 devstack sudo[110206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 1G Aug 09 13:01:58 devstack sudo[110206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:58 devstack sudo[110206]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 1G" returned: 0 in 0.455s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b55df4d-40c0-4b3f-b0e0-524569513313 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:58 devstack sudo[110211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b55df4d-40c0-4b3f-b0e0-524569513313 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 Aug 09 13:01:58 devstack sudo[110211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:58 devstack sudo[110211]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9b55df4d-40c0-4b3f-b0e0-524569513313 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4" returned: 0 in 0.360s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:58 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 is being set with open permissions: ugo+rw Aug 09 13:01:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:58 devstack sudo[110216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 Aug 09 13:01:58 devstack sudo[110216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:59 devstack sudo[110216]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4" returned: 0 in 0.257s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:59 devstack sudo[110219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.info Aug 09 13:01:59 devstack sudo[110219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:59 devstack sudo[110219]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.info" returned: 0 in 0.277s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:59 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.info is being set with open permissions: ugo+rw Aug 09 13:01:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:01:59 devstack sudo[110222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.info Aug 09 13:01:59 devstack sudo[110222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:01:59 devstack sudo[110222]: pam_unix(sudo:session): session closed for user root Aug 09 13:01:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.info" returned: 0 in 0.267s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:01:59 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.153s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:01:59 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-dd2a5ae5-9905-409d-aac7-e3d20db8da00 tempest-ProjectMemberTests-423308002 None] Create snapshot completed successfully Aug 09 13:02:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-ae5d8f3b-e526-4338-a450-1d7a10ce09e4-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Lock "cinder-ae5d8f3b-e526-4338-a450-1d7a10ce09e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-9b55df4d-40c0-4b3f-b0e0-524569513313" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-9b55df4d-40c0-4b3f-b0e0-524569513313" acquired by "delete_snapshot" :: waited 0.072s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-ae5d8f3b-e526-4338-a450-1d7a10ce09e4" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:00 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-ae5d8f3b-e526-4338-a450-1d7a10ce09e4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Deleting offline snapshot ae5d8f3b-e526-4338-a450-1d7a10ce09e4 of volume 9b55df4d-40c0-4b3f-b0e0-524569513313 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:02:00 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] snapshot_file for this snap is: volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:02:00 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[72a06ad4-8d7d-4754-9c5e-d5ff438bd17a]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:00 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Flow 'volume_create_manager' (a68bf1b9-7fbd-47cc-809e-e7624c8e13a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89662e83-db1f-449e-87b6-aa2d03f8823f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:01 devstack sudo[110226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 Aug 09 13:02:01 devstack sudo[110226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89662e83-db1f-449e-87b6-aa2d03f8823f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-84717328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36097a2f-4669-4833-a44e-64604b1290dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4860b212128949f6b5ef3e959d45f61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:02:01Z,use_quota=True,user_id='bfa66180fbf84d01afb3fb1478445b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285cf9d5-df3e-4a37-acfb-525db0eed165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (285cf9d5-df3e-4a37-acfb-525db0eed165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734ca26b-7f39-4dfa-8f5e-2e4e20b7bf82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (734ca26b-7f39-4dfa-8f5e-2e4e20b7bf82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36097a2f-4669-4833-a44e-64604b1290dc', 'volume_name': 'volume-36097a2f-4669-4833-a44e-64604b1290dc', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73658b3-a46d-4980-a2fd-fd8eca962a87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b73658b3-a46d-4980-a2fd-fd8eca962a87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44617be-dd21-4d4f-ba5d-5b2cbfc3b66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:01 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Volume 36097a2f-4669-4833-a44e-64604b1290dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36097a2f-4669-4833-a44e-64604b1290dc', 'volume_size': 1} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:02:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-84717328',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36097a2f-4669-4833-a44e-64604b1290dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4860b212128949f6b5ef3e959d45f61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:02:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:02:01Z,use_quota=True,user_id='bfa66180fbf84d01afb3fb1478445b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Creating volume 36097a2f-4669-4833-a44e-64604b1290dc {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:02:01 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:01 devstack sudo[110228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc 1073741824 Aug 09 13:02:01 devstack sudo[110228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:01 devstack sudo[110226]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4" returned: 0 in 0.375s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9b55df4d-40c0-4b3f-b0e0-524569513313(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a474e55-c5c6-439f-ad72-a37d9583ce98]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:01 devstack sudo[110234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313 Aug 09 13:02:01 devstack sudo[110234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:01 devstack sudo[110228]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc 1073741824" returned: 0 in 0.452s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:01 devstack sudo[110238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc Aug 09 13:02:01 devstack sudo[110238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:01 devstack sudo[110234]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313" returned: 0 in 0.366s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:01 devstack sudo[110243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 Aug 09 13:02:01 devstack sudo[110243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:01 devstack sudo[110238]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc" returned: 0 in 0.252s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e44617be-dd21-4d4f-ba5d-5b2cbfc3b66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36097a2f-4669-4833-a44e-64604b1290dc', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281ba4b7-b3bb-4505-809e-d5a03858ca4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:01 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Volume volume-36097a2f-4669-4833-a44e-64604b1290dc (36097a2f-4669-4833-a44e-64604b1290dc): created successfully Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281ba4b7-b3bb-4505-809e-d5a03858ca4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:01 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Flow 'volume_create_manager' (a68bf1b9-7fbd-47cc-809e-e7624c8e13a9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:01 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-cfe6cafe-6d89-4aa9-9d56-43b96e9681f4 tempest-SnapshotDependencyTests-1416033537 None] Created volume successfully. Aug 09 13:02:02 devstack sudo[110243]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4" returned: 0 in 0.362s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:02 devstack sudo[110250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4 Aug 09 13:02:02 devstack sudo[110250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] Creating offline snapshot 1e9f6d21-dde1-4e3f-a448-9ce1badf721c of volume 36097a2f-4669-4833-a44e-64604b1290dc {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f46402a-fc44-4465-9808-5b416cec3a9d]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:02 devstack sudo[110250]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313.ae5d8f3b-e526-4338-a450-1d7a10ce09e4" returned: 0 in 0.291s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-ae5d8f3b-e526-4338-a450-1d7a10ce09e4" released by "_delete_snapshot" :: held 1.496s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-9b55df4d-40c0-4b3f-b0e0-524569513313" released by "delete_snapshot" :: held 1.521s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Created reservations ['05700ba4-ca76-4780-b9d2-efc4641b8be9', '5a61277f-099f-4264-b1d5-3d95c6b4489a', 'e5ecb720-c1cd-4f48-9e6a-316b6904f3be', '76520838-7586-4018-af95-781463a737a0'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:02 devstack sudo[110253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc Aug 09 13:02:02 devstack sudo[110253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:02 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Delete snapshot completed successfully. Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-cf1a8eb8-3741-42e3-b24a-2e849926327d tempest-ProjectMemberTests-423308002 None] Lock "cinder-ae5d8f3b-e526-4338-a450-1d7a10ce09e4-delete_snapshot" released by "delete_snapshot" :: held 1.712s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:02 devstack sudo[110253]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc" returned: 0 in 0.376s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:02 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:02 devstack sudo[110258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c 1G Aug 09 13:02:02 devstack sudo[110258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-9b55df4d-40c0-4b3f-b0e0-524569513313-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Lock "cinder-9b55df4d-40c0-4b3f-b0e0-524569513313-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-9b55df4d-40c0-4b3f-b0e0-524569513313" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-9b55df4d-40c0-4b3f-b0e0-524569513313" acquired by "delete_volume" :: waited 0.016s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd86472-0da2-48f1-9ab1-51fdbd5a6327]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:03 devstack sudo[110258]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c 1G" returned: 0 in 0.452s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36097a2f-4669-4833-a44e-64604b1290dc -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:03 devstack sudo[110263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313 Aug 09 13:02:03 devstack sudo[110263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:03 devstack sudo[110264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36097a2f-4669-4833-a44e-64604b1290dc -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c Aug 09 13:02:03 devstack sudo[110264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:03 devstack sudo[110263]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313" returned: 0 in 0.391s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:03 devstack sudo[110264]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36097a2f-4669-4833-a44e-64604b1290dc -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c" returned: 0 in 0.291s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:03 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c is being set with open permissions: ugo+rw Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:03 devstack sudo[110273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313 Aug 09 13:02:03 devstack sudo[110273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:03 devstack sudo[110274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c Aug 09 13:02:03 devstack sudo[110274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:03 devstack sudo[110273]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-9b55df4d-40c0-4b3f-b0e0-524569513313" returned: 0 in 0.247s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:03 devstack sudo[110274]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c" returned: 0 in 0.250s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-9b55df4d-40c0-4b3f-b0e0-524569513313" released by "delete_volume" :: held 0.701s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:03 devstack sudo[110279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.info Aug 09 13:02:03 devstack sudo[110279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Created reservations ['34e4a21b-b06c-4635-b900-ab542b125936', '51c54070-0087-41a5-9d99-6e2852d903ba', 'a2f804c3-68e8-436c-b131-345c0beab4bf', '455df1da-1e09-4b90-93e9-231cee18b7ca'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=166,cinder:UPDATE=196,cinder:INSERT=51,cinder:DELETE=16 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=201,cinder:INSERT=54,cinder:DELETE=17,cinder:SELECT=142 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:03 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:03 devstack sudo[110281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:02:03 devstack sudo[110281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:04 devstack sudo[110279]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.info" returned: 0 in 0.270s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:04 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.info is being set with open permissions: ugo+rw Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:04 devstack sudo[110284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.info Aug 09 13:02:04 devstack sudo[110284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:04 devstack sudo[110281]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.275s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:02:04 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Deleted volume successfully. Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-5873897d-eab2-4d26-bf6f-dac8f6bed73e tempest-ProjectMemberTests-423308002 None] Lock "cinder-9b55df4d-40c0-4b3f-b0e0-524569513313-delete_volume" released by "delete_volume" :: held 1.225s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:04 devstack sudo[110284]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.info" returned: 0 in 0.277s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.022s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:04 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-74ea3dcc-4299-4dcd-b434-41840534b3c6 tempest-SnapshotDependencyTests-1416033537 None] Create snapshot completed successfully Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (8451d164-400a-4648-87f9-48268cd5e6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548653df-e238-484f-948f-7ff3b77a433c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (548653df-e238-484f-948f-7ff3b77a433c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1530275878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43086efa-c2e3-4192-a04e-2d6d2aa2a346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:02:05Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9270a939-a439-4a06-98d1-411b5592e165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9270a939-a439-4a06-98d1-411b5592e165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed481a39-85b7-411f-ac3f-5c6dc9e1daf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed481a39-85b7-411f-ac3f-5c6dc9e1daf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43086efa-c2e3-4192-a04e-2d6d2aa2a346', 'volume_name': 'volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ab2de6-c85b-4bf0-98ba-e726a64f0e01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10ab2de6-c85b-4bf0-98ba-e726a64f0e01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d23d5a-55b1-47d7-99b3-a9dc5e1a4006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:04 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Volume 43086efa-c2e3-4192-a04e-2d6d2aa2a346: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346', 'volume_size': 1} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1530275878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43086efa-c2e3-4192-a04e-2d6d2aa2a346,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:02:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:02:05Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Creating volume 43086efa-c2e3-4192-a04e-2d6d2aa2a346 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:02:04 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:02:04 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:04 devstack sudo[110288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 1073741824 Aug 09 13:02:04 devstack sudo[110288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:05 devstack sudo[110288]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 1073741824" returned: 0 in 0.408s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:05 devstack sudo[110294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 Aug 09 13:02:05 devstack sudo[110294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:05 devstack sudo[110294]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346" returned: 0 in 0.245s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8d23d5a-55b1-47d7-99b3-a9dc5e1a4006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3654211-e6c3-401e-ad71-e253bb533eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:05 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Volume volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 (43086efa-c2e3-4192-a04e-2d6d2aa2a346): created successfully Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3654211-e6c3-401e-ad71-e253bb533eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (8451d164-400a-4648-87f9-48268cd5e6aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:05 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8f191f66-d768-4a74-92ed-6f8994d9d742 tempest-ProjectMemberTests-423308002 None] Created volume successfully. Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] Creating offline snapshot 32826a18-af0a-4994-b11a-4592bdf2543f of volume 43086efa-c2e3-4192-a04e-2d6d2aa2a346 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[5992e616-e418-4f27-ae83-e3dcf3ed1cb4]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:05 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:05 devstack sudo[110297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 Aug 09 13:02:05 devstack sudo[110297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Flow 'volume_create_manager' (dfb17915-15b5-49b1-8690-de4cdbbe0bc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721ef44b-bcf0-40c7-b2ce-bf2b50c02bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (721ef44b-bcf0-40c7-b2ce-bf2b50c02bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20d7c97d-d153-4175-b0b4-46391aa27af1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4860b212128949f6b5ef3e959d45f61c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=1e9f6d21-dde1-4e3f-a448-9ce1badf721c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:02:06Z,use_quota=True,user_id='bfa66180fbf84d01afb3fb1478445b5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bd10f4-593e-4e9a-b3ae-6a74f0927707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bd10f4-593e-4e9a-b3ae-6a74f0927707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7060480d-89d1-41a9-b56f-34a4a16ae288) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7060480d-89d1-41a9-b56f-34a4a16ae288) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '20d7c97d-d153-4175-b0b4-46391aa27af1', 'volume_name': 'volume-20d7c97d-d153-4175-b0b4-46391aa27af1', 'volume_size': 1, 'snapshot_id': '1e9f6d21-dde1-4e3f-a448-9ce1badf721c'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ca0ca7-2bc0-4386-8f6e-1d13c502421e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a7ca0ca7-2bc0-4386-8f6e-1d13c502421e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d656b6c6-7e1b-458e-937e-210f2348c8d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:06 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Volume 20d7c97d-d153-4175-b0b4-46391aa27af1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-20d7c97d-d153-4175-b0b4-46391aa27af1', 'volume_size': 1, 'snapshot_id': '1e9f6d21-dde1-4e3f-a448-9ce1badf721c'} Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:06 devstack sudo[110297]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346" returned: 0 in 0.376s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:06 devstack sudo[110302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f 1G Aug 09 13:02:06 devstack sudo[110302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:06 devstack sudo[110302]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f 1G" returned: 0 in 0.385s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:06 devstack sudo[110308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f Aug 09 13:02:06 devstack sudo[110308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:06 devstack sudo[110308]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f" returned: 0 in 0.276s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:06 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f is being set with open permissions: ugo+rw Aug 09 13:02:06 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:06 devstack sudo[110313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f Aug 09 13:02:06 devstack sudo[110313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:07 devstack sudo[110313]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f" returned: 0 in 0.244s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:07 devstack sudo[110316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.info Aug 09 13:02:07 devstack sudo[110316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:07 devstack sudo[110316]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.info" returned: 0 in 0.251s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:07 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.info is being set with open permissions: ugo+rw Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:07 devstack sudo[110319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.info Aug 09 13:02:07 devstack sudo[110319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:07 devstack sudo[110319]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.info" returned: 0 in 0.243s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.474s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "cinder-quobyte-1e9f6d21-dde1-4e3f-a448-9ce1badf721c-20d7c97d-d153-4175-b0b4-46391aa27af1" by "_create_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-quobyte-1e9f6d21-dde1-4e3f-a448-9ce1badf721c-20d7c97d-d153-4175-b0b4-46391aa27af1" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Creating volume 20d7c97d-d153-4175-b0b4-46391aa27af1 from snapshot 1e9f6d21-dde1-4e3f-a448-9ce1badf721c {{(pid=89309) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "cinder-quobyte-20d7c97d-d153-4175-b0b4-46391aa27af1" by "_copy_volume_from_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-quobyte-20d7c97d-d153-4175-b0b4-46391aa27af1" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] snapshot: 1e9f6d21-dde1-4e3f-a448-9ce1badf721c, volume: 20d7c97d-d153-4175-b0b4-46391aa27af1, {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:405}} Aug 09 13:02:07 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5ab8f8d5-9c6d-4aac-962b-0ddb828d3d0c tempest-ProjectMemberTests-423308002 None] Create snapshot completed successfully Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af9cd6d-534b-4a40-8870-c341bbb8bdae]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:07 devstack sudo[110322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c Aug 09 13:02:07 devstack sudo[110322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-32826a18-af0a-4994-b11a-4592bdf2543f-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Lock "cinder-32826a18-af0a-4994-b11a-4592bdf2543f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-43086efa-c2e3-4192-a04e-2d6d2aa2a346" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-43086efa-c2e3-4192-a04e-2d6d2aa2a346" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-32826a18-af0a-4994-b11a-4592bdf2543f" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-32826a18-af0a-4994-b11a-4592bdf2543f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:07 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Deleting offline snapshot 32826a18-af0a-4994-b11a-4592bdf2543f of volume 43086efa-c2e3-4192-a04e-2d6d2aa2a346 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] snapshot_file for this snap is: volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1376be76-c920-4518-843b-f044558ee36b]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:08 devstack sudo[110322]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c" returned: 0 in 0.374s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36097a2f-4669-4833-a44e-64604b1290dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[18fdcd62-b296-4cbc-9fc1-8d1d093929a8]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:08 devstack sudo[110324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f Aug 09 13:02:08 devstack sudo[110324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:08 devstack sudo[110328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc Aug 09 13:02:08 devstack sudo[110328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:08 devstack sudo[110324]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f" returned: 0 in 0.368s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c905ab-5fab-4fe9-bcae-47cf07cebcbb]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:08 devstack sudo[110328]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc" returned: 0 in 0.373s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:426}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Creating direct copy from snapshot {{(pid=89309) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:434}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG cinder.utils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Path /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1 not found in is_blk_device check {{(pid=89309) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:08 devstack sudo[110335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 Aug 09 13:02:08 devstack sudo[110335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:08 devstack sudo[110338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1 Aug 09 13:02:08 devstack sudo[110338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:08 devstack sudo[110335]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346" returned: 0 in 0.352s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:08 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:08 devstack sudo[110347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f Aug 09 13:02:08 devstack sudo[110347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:09 devstack sudo[110347]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f" returned: 0 in 0.595s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:09 devstack sudo[110359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f Aug 09 13:02:09 devstack sudo[110359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:09 devstack sudo[110359]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:09 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346.32826a18-af0a-4994-b11a-4592bdf2543f" returned: 0 in 0.537s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:09 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-32826a18-af0a-4994-b11a-4592bdf2543f" released by "_delete_snapshot" :: held 2.001s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-43086efa-c2e3-4192-a04e-2d6d2aa2a346" released by "delete_snapshot" :: held 2.044s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:10 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Created reservations ['93238cbc-4425-4c2b-9072-5e3c151c8416', 'c0095d9c-4687-4b5c-a277-35fc74139b4c', 'ff1e471c-ffa9-4f63-9a46-7807db88cf2a', '4ea04b35-2570-4072-9f75-34f0db80bd17'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:10 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Delete snapshot completed successfully. Aug 09 13:02:10 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-9f3fbdf4-047b-42b7-8323-e0e85596293e tempest-ProjectMemberTests-423308002 None] Lock "cinder-32826a18-af0a-4994-b11a-4592bdf2543f-delete_snapshot" released by "delete_snapshot" :: held 2.418s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-43086efa-c2e3-4192-a04e-2d6d2aa2a346-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Lock "cinder-43086efa-c2e3-4192-a04e-2d6d2aa2a346-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-43086efa-c2e3-4192-a04e-2d6d2aa2a346" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:11 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-43086efa-c2e3-4192-a04e-2d6d2aa2a346" acquired by "delete_volume" :: waited 0.031s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:11 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[12478e4d-2b0d-4ed6-a42d-899da3e0446b]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:11 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:11 devstack sudo[110364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 Aug 09 13:02:11 devstack sudo[110364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:12 devstack sudo[110364]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346" returned: 0 in 0.750s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:12 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:12 devstack sudo[110370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346 Aug 09 13:02:12 devstack sudo[110370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:13 devstack sudo[110370]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-43086efa-c2e3-4192-a04e-2d6d2aa2a346" returned: 0 in 0.636s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-43086efa-c2e3-4192-a04e-2d6d2aa2a346" released by "delete_volume" :: held 1.489s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:13 devstack sudo[110338]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1" returned: 0 in 4.564s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.image.image_utils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Image conversion details: src /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc, size 1024.00 MB, duration 4.57 sec, destination /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1 {{(pid=89309) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Aug 09 13:02:13 devstack cinder-volume[89309]: INFO cinder.image.image_utils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Converted 1024.00 MB image at 224.29 MB/s Aug 09 13:02:13 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1 is being set with open permissions: ugo+rw Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Created reservations ['db36548d-7245-478b-94ea-d2ce14aaced7', 'c8ef2458-b84f-4322-8ef2-f9a1000f2e3b', '5e0ffd1d-6e6b-42ba-bfd2-9d2987bf5bd9', '61e9c28a-24ce-4e6c-8867-fb36c2757090'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:13 devstack sudo[110373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1 Aug 09 13:02:13 devstack sudo[110373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:13 devstack sudo[110375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:02:13 devstack sudo[110375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:13 devstack sudo[110373]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1" returned: 0 in 0.257s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-quobyte-20d7c97d-d153-4175-b0b4-46391aa27af1" released by "_copy_volume_from_snapshot" :: held 5.645s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-quobyte-1e9f6d21-dde1-4e3f-a448-9ce1badf721c-20d7c97d-d153-4175-b0b4-46391aa27af1" released by "_create_volume_from_snapshot" :: held 5.706s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.732s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d656b6c6-7e1b-458e-937e-210f2348c8d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20d7c97d-d153-4175-b0b4-46391aa27af1', 'volume_size': 1, 'snapshot_id': '1e9f6d21-dde1-4e3f-a448-9ce1badf721c'}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492beeca-ac80-4874-abca-b2ed4c07e794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:13 devstack sudo[110375]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.262s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:02:13 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Volume volume-20d7c97d-d153-4175-b0b4-46391aa27af1 (20d7c97d-d153-4175-b0b4-46391aa27af1): created successfully Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (492beeca-ac80-4874-abca-b2ed4c07e794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Flow 'volume_create_manager' (dfb17915-15b5-49b1-8690-de4cdbbe0bc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:13 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Deleted volume successfully. Aug 09 13:02:13 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4f0da4a1-6771-4e39-a362-a5cc140fe587 tempest-SnapshotDependencyTests-1416033537 None] Created volume successfully. Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-b87fb18b-564b-4edd-baa8-5e5497252525 tempest-ProjectMemberTests-423308002 None] Lock "cinder-43086efa-c2e3-4192-a04e-2d6d2aa2a346-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "cinder-1e9f6d21-dde1-4e3f-a448-9ce1badf721c-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-1e9f6d21-dde1-4e3f-a448-9ce1badf721c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "cinder-quobyte-36097a2f-4669-4833-a44e-64604b1290dc" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-quobyte-36097a2f-4669-4833-a44e-64604b1290dc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "cinder-quobyte-1e9f6d21-dde1-4e3f-a448-9ce1badf721c" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-quobyte-1e9f6d21-dde1-4e3f-a448-9ce1badf721c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Deleting offline snapshot 1e9f6d21-dde1-4e3f-a448-9ce1badf721c of volume 36097a2f-4669-4833-a44e-64604b1290dc {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] snapshot_file for this snap is: volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e815601a-4394-40cf-8ac6-2ecb23ff5eef]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:13 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:14 devstack sudo[110379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c Aug 09 13:02:14 devstack sudo[110379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (f712989a-2289-4c8e-8c99-ac7c7d34275b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:14 devstack sudo[110379]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cf0cb7-8840-46ca-8595-482e22432ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c" returned: 0 in 0.395s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36097a2f-4669-4833-a44e-64604b1290dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cf0cb7-8840-46ca-8595-482e22432ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-421638821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d70c86a-570a-4ac7-94fd-3c57fcb7f83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:02:14Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cefb57-13e0-46d2-a718-97c4c893ef92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65cefb57-13e0-46d2-a718-97c4c893ef92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9527c25a-091c-41b6-b727-2b27a89148ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9527c25a-091c-41b6-b727-2b27a89148ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d70c86a-570a-4ac7-94fd-3c57fcb7f83c', 'volume_name': 'volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80aecb95-ac60-4d25-8348-6a6899eea73e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80aecb95-ac60-4d25-8348-6a6899eea73e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e4cef0-1628-4b48-bf9b-93fe67274876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:14 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Volume 8d70c86a-570a-4ac7-94fd-3c57fcb7f83c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c', 'volume_size': 1} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:02:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-421638821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d70c86a-570a-4ac7-94fd-3c57fcb7f83c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:02:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:02:14Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Creating volume 8d70c86a-570a-4ac7-94fd-3c57fcb7f83c {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:02:14 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[837c0d16-7f58-48a8-8f8c-c0b91d67de7c]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:14 devstack sudo[110385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c 1073741824 Aug 09 13:02:14 devstack sudo[110385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:14 devstack sudo[110386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc Aug 09 13:02:14 devstack sudo[110386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:14 devstack sudo[110385]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c 1073741824" returned: 0 in 0.414s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:14 devstack sudo[110397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c Aug 09 13:02:14 devstack sudo[110397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:14 devstack sudo[110386]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc" returned: 0 in 0.570s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:14 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:15 devstack sudo[110400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c Aug 09 13:02:15 devstack sudo[110400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:15 devstack sudo[110397]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c" returned: 0 in 0.286s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37e4cef0-1628-4b48-bf9b-93fe67274876) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e79d50f-f992-4aed-a598-fc867020edbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:15 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Volume volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c (8d70c86a-570a-4ac7-94fd-3c57fcb7f83c): created successfully Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e79d50f-f992-4aed-a598-fc867020edbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (f712989a-2289-4c8e-8c99-ac7c7d34275b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:15 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-af9b5dbe-e006-4b56-bb65-446a455d5dfc tempest-ProjectMemberTests-423308002 None] Created volume successfully. Aug 09 13:02:15 devstack sudo[110400]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c" returned: 0 in 0.351s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:15 devstack sudo[110406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c Aug 09 13:02:15 devstack sudo[110406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] Creating offline snapshot ab35a33f-c006-4a27-998a-4c9b5738529e of volume 8d70c86a-570a-4ac7-94fd-3c57fcb7f83c {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae0018eb-b972-4ebc-965a-12de305003b0]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:15 devstack sudo[110406]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc.1e9f6d21-dde1-4e3f-a448-9ce1badf721c" returned: 0 in 0.282s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:15 devstack sudo[110408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c Aug 09 13:02:15 devstack sudo[110408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-quobyte-1e9f6d21-dde1-4e3f-a448-9ce1badf721c" released by "_delete_snapshot" :: held 1.750s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-quobyte-36097a2f-4669-4833-a44e-64604b1290dc" released by "delete_snapshot" :: held 1.774s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Created reservations ['e007492c-7dd2-4734-86b1-14a43a6d68d6', '192c26ce-4187-4a45-8149-2d5c6ec65f71', 'ec532493-ab40-43d2-8ece-5cac5f150dad', '3484772a-e2a0-46fe-b735-96254f2519e8'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:15 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Delete snapshot completed successfully. Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-ec6dde7c-6321-48b2-8ee5-7a6401a412e8 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-1e9f6d21-dde1-4e3f-a448-9ce1badf721c-delete_snapshot" released by "delete_snapshot" :: held 1.910s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:15 devstack sudo[110408]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c" returned: 0 in 0.374s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:15 devstack sudo[110414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e 1G Aug 09 13:02:15 devstack sudo[110414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:15 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "cinder-36097a2f-4669-4833-a44e-64604b1290dc-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-36097a2f-4669-4833-a44e-64604b1290dc-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "cinder-quobyte-36097a2f-4669-4833-a44e-64604b1290dc" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-quobyte-36097a2f-4669-4833-a44e-64604b1290dc" acquired by "delete_volume" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78ddede-b39e-437d-a090-8a80dd7ff7a3]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:16 devstack sudo[110418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc Aug 09 13:02:16 devstack sudo[110418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:16 devstack sudo[110414]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e 1G" returned: 0 in 0.425s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:16 devstack sudo[110422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e Aug 09 13:02:16 devstack sudo[110422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:16 devstack sudo[110418]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc" returned: 0 in 0.389s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:16 devstack sudo[110427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc Aug 09 13:02:16 devstack sudo[110427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:16 devstack sudo[110422]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e" returned: 0 in 0.306s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:16 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e is being set with open permissions: ugo+rw Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:16 devstack sudo[110432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e Aug 09 13:02:16 devstack sudo[110432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:16 devstack sudo[110427]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-36097a2f-4669-4833-a44e-64604b1290dc" returned: 0 in 0.258s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-quobyte-36097a2f-4669-4833-a44e-64604b1290dc" released by "delete_volume" :: held 0.714s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Created reservations ['5aac8320-23d2-4c31-89fe-47f6a3e12df6', 'c9681c50-f7df-401f-ac05-1fc4b45f7861', 'ba6ec302-4247-4066-9ab8-66646e54c0ac', 'b9d0d62b-cb1e-45ee-8dfb-e52c02a5dfb0'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:16 devstack sudo[110432]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e" returned: 0 in 0.251s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:16 devstack sudo[110436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.info Aug 09 13:02:16 devstack sudo[110436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:16 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:16 devstack sudo[110438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:02:16 devstack sudo[110438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "cinder-20d7c97d-d153-4175-b0b4-46391aa27af1-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:17 devstack sudo[110436]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.info" returned: 0 in 0.286s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:17 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.info is being set with open permissions: ugo+rw Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:17 devstack sudo[110438]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-20d7c97d-d153-4175-b0b4-46391aa27af1-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.283s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:17 devstack sudo[110442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.info Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:02:17 devstack sudo[110442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:17 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Deleted volume successfully. Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "cinder-quobyte-20d7c97d-d153-4175-b0b4-46391aa27af1" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-55ace56b-d9c2-4540-aeac-4ff4766c9581 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-36097a2f-4669-4833-a44e-64604b1290dc-delete_volume" released by "delete_volume" :: held 1.241s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-quobyte-20d7c97d-d153-4175-b0b4-46391aa27af1" acquired by "delete_volume" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6f71398-b958-40ed-aeb4-ff5242215ace]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:17 devstack sudo[110444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1 Aug 09 13:02:17 devstack sudo[110444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:17 devstack sudo[110442]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.info" returned: 0 in 0.276s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:17 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-8cdb77e8-d5c7-4fb4-b6b1-bb8ac41a7275 tempest-ProjectMemberTests-423308002 None] Create snapshot completed successfully Aug 09 13:02:17 devstack sudo[110444]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1" returned: 0 in 0.372s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:17 devstack sudo[110450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1 Aug 09 13:02:17 devstack sudo[110450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:17 devstack sudo[110450]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-20d7c97d-d153-4175-b0b4-46391aa27af1" returned: 0 in 0.242s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-quobyte-20d7c97d-d153-4175-b0b4-46391aa27af1" released by "delete_volume" :: held 0.654s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:17 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Created reservations ['ffaabcea-3c07-4248-8ed5-f1f62a6c304b', '9c4f5101-8e63-47c5-828a-451b1b34e52b', '19f93d84-a4e3-46af-86e9-2c5bead46e67', 'ca25dab1-4b59-482c-8042-1f2c27f3096d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:18 devstack sudo[110453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:02:18 devstack sudo[110453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:18 devstack sudo[110453]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.237s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:02:18 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Deleted volume successfully. Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-698bd181-5c58-4fa7-926b-98ac5df9e865 tempest-SnapshotDependencyTests-1416033537 None] Lock "cinder-20d7c97d-d153-4175-b0b4-46391aa27af1-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-ab35a33f-c006-4a27-998a-4c9b5738529e-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Lock "cinder-ab35a33f-c006-4a27-998a-4c9b5738529e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-ab35a33f-c006-4a27-998a-4c9b5738529e" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-ab35a33f-c006-4a27-998a-4c9b5738529e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Deleting offline snapshot ab35a33f-c006-4a27-998a-4c9b5738529e of volume 8d70c86a-570a-4ac7-94fd-3c57fcb7f83c {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] snapshot_file for this snap is: volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf86a6c-e079-4707-a38c-2698467529e0]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:18 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:18 devstack sudo[110456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e Aug 09 13:02:18 devstack sudo[110456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:19 devstack sudo[110456]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e" returned: 0 in 0.413s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:19 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:02:19 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fc9c28-a365-4a04-a0c5-19773153211f]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:19 devstack sudo[110461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c Aug 09 13:02:19 devstack sudo[110461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:19 devstack sudo[110461]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c" returned: 0 in 0.358s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:19 devstack sudo[110466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e Aug 09 13:02:19 devstack sudo[110466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:19 devstack sudo[110466]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e" returned: 0 in 0.373s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:19 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:19 devstack sudo[110472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e Aug 09 13:02:19 devstack sudo[110472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:20 devstack sudo[110472]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c.ab35a33f-c006-4a27-998a-4c9b5738529e" returned: 0 in 0.261s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-ab35a33f-c006-4a27-998a-4c9b5738529e" released by "_delete_snapshot" :: held 1.499s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c" released by "delete_snapshot" :: held 1.523s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:20 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Created reservations ['482b58a1-4210-4e75-9e18-a0f4015d8445', '14aa279f-f051-416c-a339-4ff0d1d223b1', 'a9ef6522-2c3a-4a17-9ce7-11f06cd43e3e', '9be16748-3733-40fa-9db4-ed5a3285214a'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:20 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Delete snapshot completed successfully. Aug 09 13:02:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-7393891c-3ef3-4035-b39d-962da440be4c tempest-ProjectMemberTests-423308002 None] Lock "cinder-ab35a33f-c006-4a27-998a-4c9b5738529e-delete_snapshot" released by "delete_snapshot" :: held 1.667s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Lock "cinder-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:20 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c" acquired by "delete_volume" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:20 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f0af68-a56b-46f7-bac4-61263976a60f]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:20 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:21 devstack sudo[110476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c Aug 09 13:02:21 devstack sudo[110476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:21 devstack sudo[110476]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c" returned: 0 in 0.358s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:21 devstack sudo[110482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c Aug 09 13:02:21 devstack sudo[110482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:21 devstack sudo[110482]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c" returned: 0 in 0.246s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:21 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c" released by "delete_volume" :: held 0.663s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:21 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Created reservations ['4698570f-2f37-4263-8212-6a5ad1fae72f', 'c1a02645-f6b1-4bdb-8c1b-bcfe692b19b7', 'b802b990-ff5a-41f3-a6c6-e0e0a1736443', '7831bf1c-4097-4b39-b2d3-80dd16bc2fb2'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:21 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:21 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:21 devstack sudo[110485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:02:21 devstack sudo[110485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:22 devstack sudo[110485]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.270s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:02:22 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Deleted volume successfully. Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-3b1bf417-76cf-462c-a8fe-d58d90975011 tempest-ProjectMemberTests-423308002 None] Lock "cinder-8d70c86a-570a-4ac7-94fd-3c57fcb7f83c-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (7dc781a6-fcba-41a4-a998-7396d43770f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1dba036-e254-4050-a3f4-afadcdbfcb9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1dba036-e254-4050-a3f4-afadcdbfcb9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584651358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aecf4ca1-cb0f-4ae9-946f-06be3550bc49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:02:22Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3862cb-1dad-4e89-94db-55d91c92cb26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b3862cb-1dad-4e89-94db-55d91c92cb26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e399f9e0-af2b-46eb-a2b0-25f858b1579a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e399f9e0-af2b-46eb-a2b0-25f858b1579a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aecf4ca1-cb0f-4ae9-946f-06be3550bc49', 'volume_name': 'volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56123fbd-88c1-45c2-9498-796c4e06daf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56123fbd-88c1-45c2-9498-796c4e06daf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f210eda7-e26a-43a5-b0a6-4aedc7a363cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:22 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Volume aecf4ca1-cb0f-4ae9-946f-06be3550bc49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49', 'volume_size': 1} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:02:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-584651358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aecf4ca1-cb0f-4ae9-946f-06be3550bc49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:02:22Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Creating volume aecf4ca1-cb0f-4ae9-946f-06be3550bc49 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:02:22 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:02:22 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:22 devstack sudo[110489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 1073741824 Aug 09 13:02:22 devstack sudo[110489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:23 devstack sudo[110489]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 1073741824" returned: 0 in 0.444s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:23 devstack sudo[110494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 Aug 09 13:02:23 devstack sudo[110494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:23 devstack sudo[110494]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49" returned: 0 in 0.247s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f210eda7-e26a-43a5-b0a6-4aedc7a363cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6282860f-1c37-4aed-8d36-44caa1ee9052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:23 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Volume volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 (aecf4ca1-cb0f-4ae9-946f-06be3550bc49): created successfully Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6282860f-1c37-4aed-8d36-44caa1ee9052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (7dc781a6-fcba-41a4-a998-7396d43770f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:23 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-17302eb5-bf24-4f6b-8158-cd528fae0a23 tempest-ProjectMemberTests-423308002 None] Created volume successfully. Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] Creating offline snapshot 580eeba2-97fa-4922-9b8b-a9010ed7d03a of volume aecf4ca1-cb0f-4ae9-946f-06be3550bc49 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e33800-f5b4-4987-8bfc-76f04f08f8b1]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:23 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:23 devstack sudo[110497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 Aug 09 13:02:23 devstack sudo[110497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:24 devstack sudo[110497]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49" returned: 0 in 0.420s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:24 devstack sudo[110503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a 1G Aug 09 13:02:24 devstack sudo[110503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:24 devstack sudo[110503]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a 1G" returned: 0 in 0.430s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:24 devstack sudo[110509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a Aug 09 13:02:24 devstack sudo[110509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:24 devstack sudo[110509]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a" returned: 0 in 0.297s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:24 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a is being set with open permissions: ugo+rw Aug 09 13:02:24 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:24 devstack sudo[110514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a Aug 09 13:02:24 devstack sudo[110514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:25 devstack sudo[110514]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a" returned: 0 in 0.274s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:25 devstack sudo[110517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.info Aug 09 13:02:25 devstack sudo[110517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:25 devstack sudo[110517]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.info" returned: 0 in 0.246s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:25 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.info is being set with open permissions: ugo+rw Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:25 devstack sudo[110520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.info Aug 09 13:02:25 devstack sudo[110520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:25 devstack sudo[110520]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.info" returned: 0 in 0.242s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:25 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-cfc0da3f-672f-4fe8-becd-52e5bb1abeed tempest-ProjectMemberTests-423308002 None] Create snapshot completed successfully Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-580eeba2-97fa-4922-9b8b-a9010ed7d03a-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Lock "cinder-580eeba2-97fa-4922-9b8b-a9010ed7d03a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-aecf4ca1-cb0f-4ae9-946f-06be3550bc49" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-aecf4ca1-cb0f-4ae9-946f-06be3550bc49" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-580eeba2-97fa-4922-9b8b-a9010ed7d03a" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-580eeba2-97fa-4922-9b8b-a9010ed7d03a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Deleting offline snapshot 580eeba2-97fa-4922-9b8b-a9010ed7d03a of volume aecf4ca1-cb0f-4ae9-946f-06be3550bc49 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] snapshot_file for this snap is: volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1549497-f188-4e58-a22d-0b188d4b26a0]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:25 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:26 devstack sudo[110523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a Aug 09 13:02:26 devstack sudo[110523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:26 devstack sudo[110523]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a" returned: 0 in 0.445s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:26 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:02:26 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f61bc37-9354-41de-a5ec-8c8d31ee08c0]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:26 devstack sudo[110529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 Aug 09 13:02:26 devstack sudo[110529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:26 devstack sudo[110529]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49" returned: 0 in 0.358s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:26 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:26 devstack sudo[110534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a Aug 09 13:02:26 devstack sudo[110534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:27 devstack sudo[110534]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a" returned: 0 in 0.346s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:27 devstack sudo[110540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a Aug 09 13:02:27 devstack sudo[110540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:27 devstack sudo[110540]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:27 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49.580eeba2-97fa-4922-9b8b-a9010ed7d03a" returned: 0 in 0.258s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-580eeba2-97fa-4922-9b8b-a9010ed7d03a" released by "_delete_snapshot" :: held 1.524s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-aecf4ca1-cb0f-4ae9-946f-06be3550bc49" released by "delete_snapshot" :: held 1.546s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:27 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Created reservations ['b4324df8-7092-46a1-a3e3-fc7586028ec8', '5be720ec-772b-4f00-9b6a-dae9c6209574', '4e93b844-3619-41a9-ab32-9612b602f1c6', '7ab5d6c8-92d5-4df3-820c-7d45765cb35e'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:27 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Delete snapshot completed successfully. Aug 09 13:02:27 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-09f087be-67ca-47bd-b4b4-d4c61399d73f tempest-ProjectMemberTests-423308002 None] Lock "cinder-580eeba2-97fa-4922-9b8b-a9010ed7d03a-delete_snapshot" released by "delete_snapshot" :: held 1.724s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-aecf4ca1-cb0f-4ae9-946f-06be3550bc49-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Lock "cinder-aecf4ca1-cb0f-4ae9-946f-06be3550bc49-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-aecf4ca1-cb0f-4ae9-946f-06be3550bc49" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-aecf4ca1-cb0f-4ae9-946f-06be3550bc49" acquired by "delete_volume" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc14a4a-a6f3-4316-9e2b-4cff2c8d8290]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:28 devstack sudo[110543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 Aug 09 13:02:28 devstack sudo[110543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:28 devstack sudo[110543]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49" returned: 0 in 0.410s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:28 devstack sudo[110548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49 Aug 09 13:02:28 devstack sudo[110548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:28 devstack sudo[110548]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-aecf4ca1-cb0f-4ae9-946f-06be3550bc49" returned: 0 in 0.247s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-aecf4ca1-cb0f-4ae9-946f-06be3550bc49" released by "delete_volume" :: held 0.723s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Created reservations ['e799ad9d-23d2-4684-b5e8-5c6da850340b', '3ed979d4-5563-48d4-b381-990a3698dd37', 'eb200bdb-0b82-4751-9ab8-26c6eabfe187', '237392ea-ea21-4104-8e80-c0a96b70d1a1'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:28 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:28 devstack sudo[110551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:02:28 devstack sudo[110551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:29 devstack sudo[110551]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.244s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:02:29 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Deleted volume successfully. Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-4f49299d-896d-487f-977d-973ee23f9d4e tempest-ProjectMemberTests-423308002 None] Lock "cinder-aecf4ca1-cb0f-4ae9-946f-06be3550bc49-delete_volume" released by "delete_volume" :: held 1.168s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (4ca37bd8-6d1e-4696-907d-ce29465dd157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3834babd-2bc2-4ef5-81dc-39e8ce6032e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3834babd-2bc2-4ef5-81dc-39e8ce6032e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-277896561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b49011-ebf2-4509-846d-d5563c89c852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:02:30Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5677423-673e-4c42-9226-b6b21fcf185d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5677423-673e-4c42-9226-b6b21fcf185d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f617cc51-e895-4f77-8175-7d15c5609d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f617cc51-e895-4f77-8175-7d15c5609d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b49011-ebf2-4509-846d-d5563c89c852', 'volume_name': 'volume-73b49011-ebf2-4509-846d-d5563c89c852', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4913f8b-1926-4fcc-99a3-94d1648953db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4913f8b-1926-4fcc-99a3-94d1648953db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a4ce4e-fecf-429c-bc9e-c8fa9dafa720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:29 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Volume 73b49011-ebf2-4509-846d-d5563c89c852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b49011-ebf2-4509-846d-d5563c89c852', 'volume_size': 1} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:02:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-277896561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b49011-ebf2-4509-846d-d5563c89c852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:02:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:02:30Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Creating volume 73b49011-ebf2-4509-846d-d5563c89c852 {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:02:29 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:02:29 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:29 devstack sudo[110554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852 1073741824 Aug 09 13:02:29 devstack sudo[110554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:30 devstack sudo[110554]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852 1073741824" returned: 0 in 0.391s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:30 devstack sudo[110559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852 Aug 09 13:02:30 devstack sudo[110559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:30 devstack sudo[110559]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852" returned: 0 in 0.255s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67a4ce4e-fecf-429c-bc9e-c8fa9dafa720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b49011-ebf2-4509-846d-d5563c89c852', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbecb79f-78d7-47f2-96ff-33caa4c9cb39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:30 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Volume volume-73b49011-ebf2-4509-846d-d5563c89c852 (73b49011-ebf2-4509-846d-d5563c89c852): created successfully Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbecb79f-78d7-47f2-96ff-33caa4c9cb39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (4ca37bd8-6d1e-4696-907d-ce29465dd157) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:30 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-5a66316e-8fe0-4dc9-a9a6-7639f9ccb83c tempest-ProjectMemberTests-423308002 None] Created volume successfully. Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] Creating offline snapshot c9d5a122-1050-4f29-879b-f59a133007a4 of volume 73b49011-ebf2-4509-846d-d5563c89c852 {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[d653ba70-ccd5-4413-85d4-31d9c6af8bea]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:30 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:30 devstack sudo[110563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852 Aug 09 13:02:30 devstack sudo[110563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:31 devstack sudo[110563]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852" returned: 0 in 0.374s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:31 devstack sudo[110568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 1G Aug 09 13:02:31 devstack sudo[110568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:31 devstack sudo[110568]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 1G" returned: 0 in 0.396s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73b49011-ebf2-4509-846d-d5563c89c852 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:31 devstack sudo[110573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73b49011-ebf2-4509-846d-d5563c89c852 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 Aug 09 13:02:31 devstack sudo[110573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:31 devstack sudo[110573]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-73b49011-ebf2-4509-846d-d5563c89c852 -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4" returned: 0 in 0.300s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:31 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 is being set with open permissions: ugo+rw Aug 09 13:02:31 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:31 devstack sudo[110579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 Aug 09 13:02:31 devstack sudo[110579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:32 devstack sudo[110579]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4" returned: 0 in 0.242s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:32 devstack sudo[110582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.info Aug 09 13:02:32 devstack sudo[110582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:32 devstack sudo[110582]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.info" returned: 0 in 0.241s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:32 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.info is being set with open permissions: ugo+rw Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:32 devstack sudo[110585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.info Aug 09 13:02:32 devstack sudo[110585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:32 devstack sudo[110585]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.info" returned: 0 in 0.248s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.875s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:32 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-e3aec1f5-3d95-4560-a97e-21813857fcdc tempest-ProjectMemberTests-423308002 None] Create snapshot completed successfully Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-c9d5a122-1050-4f29-879b-f59a133007a4-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Lock "cinder-c9d5a122-1050-4f29-879b-f59a133007a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-73b49011-ebf2-4509-846d-d5563c89c852" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-73b49011-ebf2-4509-846d-d5563c89c852" acquired by "delete_snapshot" :: waited 0.017s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-c9d5a122-1050-4f29-879b-f59a133007a4" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-c9d5a122-1050-4f29-879b-f59a133007a4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Deleting offline snapshot c9d5a122-1050-4f29-879b-f59a133007a4 of volume 73b49011-ebf2-4509-846d-d5563c89c852 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:02:32 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] snapshot_file for this snap is: volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:02:33 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a429f4-8ba9-48c3-83a4-231951a6b002]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:33 devstack sudo[110588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 Aug 09 13:02:33 devstack sudo[110588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:33 devstack sudo[110588]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4" returned: 0 in 0.362s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:33 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-73b49011-ebf2-4509-846d-d5563c89c852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:02:33 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b25846-6a66-44c6-b208-7bec10865612]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:33 devstack sudo[110593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852 Aug 09 13:02:33 devstack sudo[110593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:33 devstack sudo[110593]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852" returned: 0 in 0.341s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:33 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:33 devstack sudo[110598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 Aug 09 13:02:33 devstack sudo[110598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:34 devstack sudo[110598]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4" returned: 0 in 0.328s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:34 devstack sudo[110603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4 Aug 09 13:02:34 devstack sudo[110603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:34 devstack sudo[110603]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:34 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852.c9d5a122-1050-4f29-879b-f59a133007a4" returned: 0 in 0.235s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-c9d5a122-1050-4f29-879b-f59a133007a4" released by "_delete_snapshot" :: held 1.358s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-73b49011-ebf2-4509-846d-d5563c89c852" released by "delete_snapshot" :: held 1.380s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:34 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Created reservations ['9550ffe6-e483-4df5-bec3-7ab42ad3e238', '16c7286c-e00f-400e-bd5d-57816fc0143c', '145a382a-0c1d-402e-a4d7-d5610ab464d5', '3efab23d-714b-4628-994c-a89495ecdf51'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:34 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Delete snapshot completed successfully. Aug 09 13:02:34 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-791155b3-ef33-43a0-958a-31f1fba4d5e1 tempest-ProjectMemberTests-423308002 None] Lock "cinder-c9d5a122-1050-4f29-879b-f59a133007a4-delete_snapshot" released by "delete_snapshot" :: held 1.513s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-73b49011-ebf2-4509-846d-d5563c89c852-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Lock "cinder-73b49011-ebf2-4509-846d-d5563c89c852-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-73b49011-ebf2-4509-846d-d5563c89c852" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-73b49011-ebf2-4509-846d-d5563c89c852" acquired by "delete_volume" :: waited 0.020s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9b346f-f59d-4be1-9b20-9f681670cab9]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:35 devstack sudo[110606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852 Aug 09 13:02:35 devstack sudo[110606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:35 devstack sudo[110606]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852" returned: 0 in 0.365s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:35 devstack sudo[110611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852 Aug 09 13:02:35 devstack sudo[110611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:35 devstack sudo[110611]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-73b49011-ebf2-4509-846d-d5563c89c852" returned: 0 in 0.244s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-73b49011-ebf2-4509-846d-d5563c89c852" released by "delete_volume" :: held 0.666s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Created reservations ['47337a67-46cb-4b3e-b2f4-221de434bd13', 'e7a1ee8d-9aa9-42e9-96ac-8e165342052d', '349385e3-379f-42f7-bd09-74d7ce86d92b', 'b0015472-3096-41d2-9972-cdcc60e4f9fa'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:35 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:35 devstack sudo[110614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:02:35 devstack sudo[110614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:36 devstack sudo[110614]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.248s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:02:36 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Deleted volume successfully. Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-21d60865-1928-4c06-a627-bb8d9452f1ee tempest-ProjectMemberTests-423308002 None] Lock "cinder-73b49011-ebf2-4509-846d-d5563c89c852-delete_volume" released by "delete_volume" :: held 1.111s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.flows.manager.create_volume [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=89309) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (e9bb5361-1aa8-4967-8969-989b55c1b08c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad46f99a-d641-4829-9b08-3596a84384b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad46f99a-d641-4829-9b08-3596a84384b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907704637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1e77b2-e6ce-467c-8604-24f312076fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:02:37Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a93af30-ea31-4d00-8ab5-b7fac2086a5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a93af30-ea31-4d00-8ab5-b7fac2086a5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72cc6d01-a109-490c-b117-1e5b1bdc8dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72cc6d01-a109-490c-b117-1e5b1bdc8dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d1e77b2-e6ce-467c-8604-24f312076fca', 'volume_name': 'volume-1d1e77b2-e6ce-467c-8604-24f312076fca', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3960244a-324a-477b-a4fc-fb0892760008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3960244a-324a-477b-a4fc-fb0892760008) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5997e763-f2f4-4bd3-ae15-88cc4ebdbdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:36 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Volume 1d1e77b2-e6ce-467c-8604-24f312076fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d1e77b2-e6ce-467c-8604-24f312076fca', 'volume_size': 1} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-08-09T11:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-907704637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d1e77b2-e6ce-467c-8604-24f312076fca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc37ba20a2214efd98c773af2b64af60',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-08-09T11:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-08-09T11:02:37Z,use_quota=True,user_id='6adb04f8fe2841dba8182fff4d9da505',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0210b861-c4f7-4c60-97d1-20c10a963db4),volume_type_id=0210b861-c4f7-4c60-97d1-20c10a963db4)}" {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Creating volume 1d1e77b2-e6ce-467c-8604-24f312076fca {{(pid=89309) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Selected osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 as target Quobyte volume. {{(pid=89309) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:716}} Aug 09 13:02:36 devstack cinder-volume[89309]: INFO cinder.volume.drivers.remotefs [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] casted to osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622 Aug 09 13:02:36 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca 1073741824 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:36 devstack sudo[110617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca 1073741824 Aug 09 13:02:36 devstack sudo[110617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:37 devstack sudo[110617]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca 1073741824" returned: 0 in 0.410s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:37 devstack sudo[110622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca Aug 09 13:02:37 devstack sudo[110622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:37 devstack sudo[110622]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca" returned: 0 in 0.259s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'} {{(pid=89309) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5997e763-f2f4-4bd3-ae15-88cc4ebdbdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d1e77b2-e6ce-467c-8604-24f312076fca', 'volume_size': 1}' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26aa2ed6-84a3-406a-a89f-5f1173e8da25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Aug 09 13:02:37 devstack cinder-volume[89309]: INFO cinder.volume.flows.manager.create_volume [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Volume volume-1d1e77b2-e6ce-467c-8604-24f312076fca (1d1e77b2-e6ce-467c-8604-24f312076fca): created successfully Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26aa2ed6-84a3-406a-a89f-5f1173e8da25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=89309) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Flow 'volume_create_manager' (e9bb5361-1aa8-4967-8969-989b55c1b08c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=89309) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Aug 09 13:02:37 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-874d2a03-fd31-4e05-b9d1-dddaa1a4c41c tempest-ProjectMemberTests-423308002 None] Created volume successfully. Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] Creating offline snapshot c7ee4705-5b6a-45ee-830c-09a09e3c317c of volume 1d1e77b2-e6ce-467c-8604-24f312076fca {{(pid=89309) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[6def7f88-7fc6-4878-8ab7-13c9522d8349]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:37 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:37 devstack sudo[110625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca Aug 09 13:02:37 devstack sudo[110625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:38 devstack sudo[110625]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca" returned: 0 in 0.351s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c 1G {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:38 devstack sudo[110630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c 1G Aug 09 13:02:38 devstack sudo[110630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:38 devstack sudo[110630]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c 1G" returned: 0 in 0.385s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d1e77b2-e6ce-467c-8604-24f312076fca -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:38 devstack sudo[110635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d1e77b2-e6ce-467c-8604-24f312076fca -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c Aug 09 13:02:38 devstack sudo[110635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:38 devstack sudo[110635]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d1e77b2-e6ce-467c-8604-24f312076fca -F qcow2 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c" returned: 0 in 0.306s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:38 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c is being set with open permissions: ugo+rw Aug 09 13:02:38 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:38 devstack sudo[110640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c Aug 09 13:02:38 devstack sudo[110640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:39 devstack sudo[110640]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c" returned: 0 in 0.237s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:39 devstack sudo[110643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.info Aug 09 13:02:39 devstack sudo[110643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:39 devstack sudo[110643]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.info" returned: 0 in 0.249s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:39 devstack cinder-volume[89309]: WARNING cinder.volume.drivers.remotefs [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.info is being set with open permissions: ugo+rw Aug 09 13:02:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.info {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:39 devstack sudo[110646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.info Aug 09 13:02:39 devstack sudo[110646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:39 devstack sudo[110646]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.info" returned: 0 in 0.237s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:39 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.842s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:39 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-d643445a-1946-4a82-a457-200865f18679 tempest-ProjectMemberTests-423308002 None] Create snapshot completed successfully Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-c7ee4705-5b6a-45ee-830c-09a09e3c317c-delete_snapshot" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Lock "cinder-c7ee4705-5b6a-45ee-830c-09a09e3c317c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-1d1e77b2-e6ce-467c-8604-24f312076fca" by "delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-1d1e77b2-e6ce-467c-8604-24f312076fca" acquired by "delete_snapshot" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-c7ee4705-5b6a-45ee-830c-09a09e3c317c" by "_delete_snapshot" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-c7ee4705-5b6a-45ee-830c-09a09e3c317c" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Deleting offline snapshot c7ee4705-5b6a-45ee-830c-09a09e3c317c of volume 1d1e77b2-e6ce-467c-8604-24f312076fca {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] snapshot_file for this snap is: volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c {{(pid=89309) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd314ca8-6711-4c4e-9b18-03f01590f0e3]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:40 devstack sudo[110649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c Aug 09 13:02:40 devstack sudo[110649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:40 devstack sudo[110649]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c" returned: 0 in 0.353s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.remotefs [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d1e77b2-e6ce-467c-8604-24f312076fca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=89309) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[235521d1-8230-48eb-bb11-2f4d5611fdd7]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:40 devstack sudo[110654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca Aug 09 13:02:40 devstack sudo[110654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:40 devstack sudo[110654]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca" returned: 0 in 0.351s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:40 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:40 devstack sudo[110660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c Aug 09 13:02:40 devstack sudo[110660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:41 devstack sudo[110660]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c" returned: 0 in 0.324s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:41 devstack sudo[110666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c Aug 09 13:02:41 devstack sudo[110666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:41 devstack sudo[110666]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:41 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca.c7ee4705-5b6a-45ee-830c-09a09e3c317c" returned: 0 in 0.254s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-c7ee4705-5b6a-45ee-830c-09a09e3c317c" released by "_delete_snapshot" :: held 1.369s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-1d1e77b2-e6ce-467c-8604-24f312076fca" released by "delete_snapshot" :: held 1.391s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:41 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Created reservations ['8a4124dd-571b-4f1e-82a0-b56e0058a27c', 'f78572ec-e656-4e3e-a41e-3ff27e85b128', 'ce8b65b5-2c80-4327-86ab-fcf2d0ea9576', '81962532-f932-47b0-8ada-74978e5d0e8d'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:41 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Delete snapshot completed successfully. Aug 09 13:02:41 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-78c225ab-63b7-44d0-8b12-6b69387c9719 tempest-ProjectMemberTests-423308002 None] Lock "cinder-c7ee4705-5b6a-45ee-830c-09a09e3c317c-delete_snapshot" released by "delete_snapshot" :: held 1.521s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-1d1e77b2-e6ce-467c-8604-24f312076fca-delete_volume" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Lock "cinder-1d1e77b2-e6ce-467c-8604-24f312076fca-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Acquiring lock "cinder-quobyte-1d1e77b2-e6ce-467c-8604-24f312076fca" by "delete_volume" {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Aug 09 13:02:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-1d1e77b2-e6ce-467c-8604-24f312076fca" acquired by "delete_volume" :: waited 0.018s {{(pid=89309) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Aug 09 13:02:42 devstack cinder-volume[89309]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e790341-bcdc-4359-ab6b-4a1f084bd058]: (4, 'qcow2') {{(pid=90888) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Aug 09 13:02:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:42 devstack sudo[110669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca Aug 09 13:02:42 devstack sudo[110669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:42 devstack sudo[110669]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca" returned: 0 in 0.355s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:42 devstack sudo[110674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca Aug 09 13:02:42 devstack sudo[110674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:42 devstack sudo[110674]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:42 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28/volume-1d1e77b2-e6ce-467c-8604-24f312076fca" returned: 0 in 0.241s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:42 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Lock "cinder-quobyte-1d1e77b2-e6ce-467c-8604-24f312076fca" released by "delete_volume" :: held 0.647s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:42 devstack cinder-volume[89309]: DEBUG cinder.quota [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Created reservations ['346cdddf-1934-45a7-ba1e-39ba90ba69e2', 'f3bc6e49-aba2-4ebb-8d6c-8f9f9370c1b7', 'd62e8374-18b8-4690-9253-7013f502383e', '8bbd4f3e-cf24-47ee-9e9e-3f867bc70619'] {{(pid=89309) reserve /opt/stack/cinder/cinder/quota.py:752}} Aug 09 13:02:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:43 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:43 devstack sudo[110677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:02:43 devstack sudo[110677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:43 devstack sudo[110677]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:43 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.244s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:43 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:02:43 devstack cinder-volume[89309]: INFO cinder.volume.manager [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Deleted volume successfully. Aug 09 13:02:43 devstack cinder-volume[89309]: DEBUG cinder.coordination [None req-904cc5f7-6b9c-4c89-b8b6-e1fc3dc5afaf tempest-ProjectMemberTests-423308002 None] Lock "cinder-1d1e77b2-e6ce-467c-8604-24f312076fca-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=89309) __release /opt/stack/cinder/cinder/coordination.py:152}} Aug 09 13:02:53 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:SELECT=92,cinder:UPDATE=112,cinder:INSERT=29,cinder:DELETE=7 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 13:02:53 devstack cinder-volume[89309]: DEBUG dbcounter [-] [89309] Writing DB stats cinder:UPDATE=126,cinder:DELETE=13,cinder:SELECT=87,cinder:INSERT=34 {{(pid=89309) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Aug 09 13:02:57 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 13:02:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Aug 09 13:02:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Aug 09 13:02:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622': None} {{(pid=89309) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:665}} Aug 09 13:02:57 devstack cinder-volume[89309]: DEBUG cinder.volume.drivers.quobyte [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-923dc64f-ab96-435d-9511-78841d6eb622'] {{(pid=89309) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:695}} Aug 09 13:02:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.lockutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=89309) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Aug 09 13:02:57 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Aug 09 13:02:57 devstack sudo[110729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28 Aug 09 13:02:57 devstack sudo[110729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Aug 09 13:02:58 devstack sudo[110729]: pam_unix(sudo:session): session closed for user root Aug 09 13:02:58 devstack cinder-volume[89309]: DEBUG oslo_concurrency.processutils [None req-737d0ccf-4d64-4026-8608-81953907108d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7cd85ceaea4e53bfa3bd798777694d28" returned: 0 in 0.242s {{(pid=89309) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Aug 09 13:02:58 devstack cinder-volume[89309]: DEBUG cinder.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Notifying Schedulers of capabilities ... {{(pid=89309) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Aug 09 13:02:58 devstack cinder-volume[89309]: DEBUG oslo_service.periodic_task [None req-737d0ccf-4d64-4026-8608-81953907108d None None] Running periodic task VolumeManager._thread_info {{(pid=89309) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Aug 09 13:02:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread count: 28 {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Aug 09 13:02:58 devstack cinder-volume[89309]: DEBUG cinder.volume.manager [None req-737d0ccf-4d64-4026-8608-81953907108d None None] thread info: [<_MainThread(MainThread, started 134141893226624)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=89309) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}}